-- Logs begin at Tue 2022-06-07 21:16:28 UTC, end at Tue 2022-06-07 22:23:47 UTC. -- Jun 07 21:54:23.664219 dv-cinder-835525-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 07 21:54:23.672809 dv-cinder-835525-4-iscsi devstack@n-api.service[103359]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 07 21:54:23.674884 dv-cinder-835525-4-iscsi devstack@n-api.service[103359]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jun 7 21:54:23 2022] *** Jun 07 21:54:23.674884 dv-cinder-835525-4-iscsi devstack@n-api.service[103359]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 07 21:54:23.674884 dv-cinder-835525-4-iscsi devstack@n-api.service[103359]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 07 21:54:23.674884 dv-cinder-835525-4-iscsi devstack@n-api.service[103359]: nodename: dv-cinder-835525-4-iscsi Jun 07 21:54:23.674884 dv-cinder-835525-4-iscsi devstack@n-api.service[103359]: machine: x86_64 Jun 07 21:54:23.674884 dv-cinder-835525-4-iscsi devstack@n-api.service[103359]: clock source: unix Jun 07 21:54:23.674884 dv-cinder-835525-4-iscsi devstack@n-api.service[103359]: pcre jit disabled Jun 07 21:54:23.674884 dv-cinder-835525-4-iscsi devstack@n-api.service[103359]: detected number of CPU cores: 4 Jun 07 21:54:23.674884 dv-cinder-835525-4-iscsi devstack@n-api.service[103359]: current working directory: / Jun 07 21:54:23.674884 dv-cinder-835525-4-iscsi devstack@n-api.service[103359]: detected binary path: /usr/bin/uwsgi-core Jun 07 21:54:23.674884 dv-cinder-835525-4-iscsi devstack@n-api.service[103359]: your processes number limit is 47680 Jun 07 21:54:23.674884 dv-cinder-835525-4-iscsi devstack@n-api.service[103359]: your memory page size is 4096 bytes Jun 07 21:54:23.674884 dv-cinder-835525-4-iscsi devstack@n-api.service[103359]: detected max file descriptor number: 2048 Jun 07 21:54:23.674884 dv-cinder-835525-4-iscsi devstack@n-api.service[103359]: lock engine: pthread robust mutexes Jun 07 21:54:23.675741 dv-cinder-835525-4-iscsi devstack@n-api.service[103359]: thunder lock: enabled Jun 07 21:54:23.675741 dv-cinder-835525-4-iscsi devstack@n-api.service[103359]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 07 21:54:23.675741 dv-cinder-835525-4-iscsi devstack@n-api.service[103359]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 07 21:54:23.719782 dv-cinder-835525-4-iscsi devstack@n-api.service[103359]: Python main interpreter initialized at 0x5585946839c0 Jun 07 21:54:23.719782 dv-cinder-835525-4-iscsi devstack@n-api.service[103359]: python threads support enabled Jun 07 21:54:23.719782 dv-cinder-835525-4-iscsi devstack@n-api.service[103359]: your server socket listen backlog is limited to 100 connections Jun 07 21:54:23.719782 dv-cinder-835525-4-iscsi devstack@n-api.service[103359]: your mercy for graceful operations on workers is 90 seconds Jun 07 21:54:23.720148 dv-cinder-835525-4-iscsi devstack@n-api.service[103359]: mapped 403077 bytes (393 KB) for 2 cores Jun 07 21:54:23.720238 dv-cinder-835525-4-iscsi devstack@n-api.service[103359]: *** Operational MODE: preforking *** Jun 07 21:54:23.720450 dv-cinder-835525-4-iscsi devstack@n-api.service[103359]: *** uWSGI is running in multiple interpreter mode *** Jun 07 21:54:23.720450 dv-cinder-835525-4-iscsi devstack@n-api.service[103359]: spawned uWSGI master process (pid: 103359) Jun 07 21:54:23.720650 dv-cinder-835525-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 07 21:54:23.723626 dv-cinder-835525-4-iscsi devstack@n-api.service[103359]: spawned uWSGI worker 1 (pid: 103360, cores: 1) Jun 07 21:54:23.723626 dv-cinder-835525-4-iscsi devstack@n-api.service[103359]: spawned uWSGI worker 2 (pid: 103361, cores: 1) Jun 07 21:54:23.723626 dv-cinder-835525-4-iscsi devstack@n-api.service[103359]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 07 21:54:24.967052 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 07 21:54:24.967910 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 07 21:54:25.680405 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 21:54:25.680405 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: from cryptography.utils import int_from_bytes Jun 07 21:54:25.680747 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 21:54:25.680747 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: from cryptography.utils import int_from_bytes Jun 07 21:54:25.680994 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 21:54:25.680994 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: from cryptography.utils import int_from_bytes Jun 07 21:54:25.681732 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 21:54:25.681732 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: from cryptography.utils import int_from_bytes Jun 07 21:54:28.232987 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 07 21:54:28.233653 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 07 21:54:28.234005 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 07 21:54:28.234108 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 07 21:54:28.234206 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 07 21:54:28.234293 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 07 21:54:28.234374 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 07 21:54:28.234452 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 07 21:54:28.234540 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 07 21:54:28.234621 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 07 21:54:28.234699 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.234777 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.235025 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.235123 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.235362 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.235455 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.235688 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.235787 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.236018 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.236125 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.236328 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.236418 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.236647 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.236744 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.236964 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.237052 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.237290 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.237376 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.237547 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.237640 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.237862 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.237949 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.238183 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835525-4-iscsi {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.238279 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835525-4-iscsi {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.238502 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.238596 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.238809 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.238920 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.239117 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.239224 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.239454 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.239558 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.239758 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.239850 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.240078 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.240181 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.240383 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.240480 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.240875 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.240989 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.242017 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.242152 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.242272 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.242362 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.242449 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.242542 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.242628 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.242718 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.242816 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.242913 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.243001 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.243087 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.243166 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.243244 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.243531 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.243643 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.243900 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.244040 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.244218 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.244322 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.244597 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835525-4-iscsi {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.244699 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835525-4-iscsi {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.244915 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.245004 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.245226 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.245362 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.245539 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.245644 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.245949 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.246051 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.246262 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.246435 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.246570 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.246665 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.246892 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.246980 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.247211 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.247310 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.247544 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.247643 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.247869 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.247968 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.248190 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.248285 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.248506 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.248593 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.248823 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.248926 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.249194 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.249302 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.249428 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.249516 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.249735 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.249829 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.250050 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.250138 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.250353 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.250441 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.250657 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.250750 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.250903 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.250990 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.251208 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.251296 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.251553 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.251654 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.251874 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.251961 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.252192 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.252283 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.252442 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.252538 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.252688 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.252777 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.253005 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.253094 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.253325 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.253413 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.253634 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.253733 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.253940 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.254026 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.254242 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.254331 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.254549 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.254637 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.254855 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.254950 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.255160 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.255247 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.255487 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.255591 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.255796 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.255894 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.256113 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.256201 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.256424 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.256514 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.256746 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.256844 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.257055 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.257149 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.257371 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.257457 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.257766 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.257864 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.258016 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.258103 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.258319 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.258406 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.258655 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.258743 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.259020 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.259154 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.259433 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.259581 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.259704 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.259820 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.260042 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.260134 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.260352 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.260448 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.260656 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.260745 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.260965 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.261053 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.261284 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.261371 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.261606 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.261701 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.261912 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.262000 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.262161 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.262258 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.262460 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.262549 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.262766 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.262852 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.263082 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.263182 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.263410 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.263503 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.263720 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.263819 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.264026 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.264126 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.264322 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.264409 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.264626 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.264714 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.264929 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.265026 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.265235 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.265337 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.265538 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.265631 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.265842 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.265943 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.266144 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.266231 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.266447 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.266535 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.266747 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.266843 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.267048 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.267189 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.267385 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.267489 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.267706 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.267803 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.268013 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.268110 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.268315 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.268403 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.268621 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.268709 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.268923 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.269019 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.269241 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.269327 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.269543 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.269677 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.269849 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.269941 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.270165 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.270264 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.270468 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.270558 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.270770 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.270857 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.271084 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.271173 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.271413 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.271505 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.271719 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.271805 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.272035 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.272120 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.272331 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.272420 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.272635 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.272724 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.272948 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.273039 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.273251 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.273341 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.273553 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.273648 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.273855 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.273972 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.274155 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.274242 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.274455 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.274543 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.275413 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.275516 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.275726 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.275802 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.276033 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.276120 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.276334 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.276430 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.276651 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.276747 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.276972 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.277061 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.277281 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.277378 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.277585 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.277671 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.277889 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.277990 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.278206 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.278294 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:54:28.278538 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.278632 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.278871 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.278964 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.279218 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.279305 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.279556 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.279645 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.279889 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.279980 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.280217 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.280307 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.280536 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.280631 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.280849 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.280949 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.281161 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.281248 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.281486 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.281581 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.281794 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.281889 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.282104 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.282190 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.282412 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.282498 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.282730 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.282824 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.283047 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.283154 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.283399 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.283502 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.283716 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.283812 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.284032 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.284130 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.284345 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.284439 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.284655 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.284752 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.284969 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.285056 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.285294 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.285389 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.285609 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.285705 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.285917 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.286005 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.286253 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.286340 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.286596 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.286691 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.286905 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.286999 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.287228 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.287373 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.287568 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.287665 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.287878 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.287965 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.288185 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.288274 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.288494 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.288584 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.288812 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.288899 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.289147 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.289245 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.289456 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.289544 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.289773 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.289904 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.290083 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.290170 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.290937 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.291160 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.291272 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.291381 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.291555 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.291659 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.291866 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.291954 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.292199 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.292294 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.292515 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.292613 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.292830 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.292919 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.293142 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.293229 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.293454 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.293554 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.293767 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.293855 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.294084 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.294220 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.294395 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.294504 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.294697 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.294786 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.295000 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.295096 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.295301 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.295411 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.295628 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.295718 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.295932 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.296021 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.296249 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.296338 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.296576 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.296671 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.296881 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.296975 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.297213 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.297303 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.297516 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.297603 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.297827 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.297927 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.298133 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.298229 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.298443 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.298536 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.298745 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.298840 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.299059 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.299145 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.299383 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.299486 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.299689 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.299788 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.300010 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.300110 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.300320 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.300406 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.300622 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.300718 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.300944 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.301033 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.301247 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.301335 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.301550 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.301649 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.301860 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.301947 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.302169 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.302255 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.302475 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.302563 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.302786 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.302872 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.303092 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.303178 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.303432 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.303525 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.303748 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.303849 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.304061 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.304162 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.304394 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.304492 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.304718 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.304814 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.305023 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.305118 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.305343 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.305442 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.305666 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.305755 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.306007 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.306104 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.306315 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.306444 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.306627 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.306761 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.306934 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.307068 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.307240 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.307394 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.307570 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.307700 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.307881 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.308010 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.308186 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.308311 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.308492 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.308614 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.308794 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.308920 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.309097 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.309220 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.309402 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.309522 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.309725 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.309842 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.310037 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.310150 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.310343 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.310452 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.310649 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.310741 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.310955 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.311044 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.311303 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.311458 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.311636 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.311726 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.311979 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.312074 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.312313 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.312408 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.312634 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.312724 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.312956 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.313045 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.313271 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.313367 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.313584 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.313670 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.313891 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.313978 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.314204 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.314300 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.314518 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.314617 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.314825 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.314920 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.315143 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.315244 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.315475 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.315567 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.315795 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.315883 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.316104 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.316203 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.316423 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.316511 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.316733 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.316820 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.317049 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.317148 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.317352 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.317440 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.317666 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.317752 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.318002 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.318100 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.318334 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.318422 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.318652 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.318738 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.318972 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.319060 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.319285 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.319389 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.319618 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.319720 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.319925 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.320015 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.320236 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.320325 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.320544 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.320681 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.320856 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.320944 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.321170 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.321257 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.321512 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.321609 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.321831 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.321979 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.322142 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.322294 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.322456 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.322617 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.322765 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.322927 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.323086 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.323246 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.323414 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.323583 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.323729 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.323896 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.324055 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.324218 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.324388 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.324576 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.324702 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.324857 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.325016 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.325168 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.325335 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.325488 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.325647 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.325796 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.325956 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.326102 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.326266 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.326410 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.326560 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.326715 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.326866 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.327018 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.327176 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.327364 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.327518 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.327659 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.327829 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.327967 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.328138 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.328274 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.328443 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.328580 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.328755 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.328894 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.329066 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.329201 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.329371 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.329505 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.329675 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.329806 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.329991 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.330118 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.330316 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.330438 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.330632 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.330751 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.330957 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.331106 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.331289 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.331409 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.331623 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.331726 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.331932 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.332021 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.332257 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.332344 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.332571 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.332673 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.332878 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.332969 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.333182 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.333279 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.333487 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.333582 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.333827 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.333926 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.334137 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.334240 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.334441 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.334536 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.334758 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.334872 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.335071 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.335159 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.335401 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.335509 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.335714 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.335806 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.336022 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.336111 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.336327 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.336431 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.336644 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.336732 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.336954 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.337050 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.337800 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.337900 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.338108 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.338223 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.338420 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.338519 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.338728 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.338819 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.339036 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.339132 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.339381 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.339489 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.339689 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.339780 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.339999 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.340088 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.340305 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.340444 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.340608 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.340695 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.340914 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.341003 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.341230 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.341327 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.341796 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.341961 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.342129 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.342219 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.342443 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.342532 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.342760 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.342854 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.343077 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.343164 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.343420 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.343514 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.343750 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.343839 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.344078 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.344165 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.344415 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.344512 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.344720 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.344879 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.345026 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.345114 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.345330 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.345417 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.345631 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.345720 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.345941 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.346030 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.346245 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.346333 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.346548 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.346636 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.346851 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.346937 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.347155 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.347242 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.347741 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.347835 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.348047 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.348147 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.348347 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.348443 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.348647 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.348733 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.348956 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.349043 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.349255 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.349355 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.349565 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.349653 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.349864 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.349950 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.350183 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.350280 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.350487 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.350574 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.350789 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.350878 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.351091 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.351259 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.351409 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.351494 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.351743 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.351844 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.352043 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.352133 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.352376 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.352473 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.352720 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.353320 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.353617 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.353714 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.353924 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.354014 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.354229 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.354318 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.354552 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.354642 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.354855 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.354991 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.355156 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.355245 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.355478 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.355570 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.355786 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.355874 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.356092 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.356191 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.356390 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.356486 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.356698 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.356795 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.357004 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.357100 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.357309 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.357396 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.357616 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.357710 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.357915 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.358012 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.358220 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.358310 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.358522 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.358609 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.358830 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.358925 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.359134 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.359230 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.359459 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.359551 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.359758 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.359848 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.360063 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.360157 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.360365 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.360454 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.360668 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.360756 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.360972 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.361059 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.361276 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.361370 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.361584 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.361684 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.361885 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.361975 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.362186 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.362273 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.362483 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.362571 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.362789 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.362877 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.363093 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.363193 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.363413 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.363504 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.363734 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.363824 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.364042 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.364148 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.364342 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.364429 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.364637 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.364724 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.364941 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.365079 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.365240 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.365330 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.365541 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.365630 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.365846 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.365942 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.366162 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.366257 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.366474 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.366561 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.366772 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.366877 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.367077 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.367170 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.367401 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.367496 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.367704 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.367810 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.368004 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.368094 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.368309 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.368405 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.368630 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.368822 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.369033 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.369124 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.369344 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.369432 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.369647 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.369737 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.369949 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.370037 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.370267 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.370364 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.370576 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.370677 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.370880 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.370969 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.371184 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.371285 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.371528 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.371617 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.371868 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.371959 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.372170 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.372268 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.372524 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.372619 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.372830 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.372917 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.373138 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.373233 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.373454 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.373541 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.373762 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.373857 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.374069 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.374165 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.374378 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.374466 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.374677 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.374765 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.374989 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.375078 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.375296 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.375433 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.375627 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.375741 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.375928 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.376032 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.376227 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.376332 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.376544 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.376641 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.376853 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.376950 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.377161 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.377250 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.377477 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.377568 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.377795 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.377885 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.378117 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.378215 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.378422 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.378519 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.378724 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.378819 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.379032 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.379122 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.379349 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.379453 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.379655 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.379743 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.379959 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.380047 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.380267 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.380440 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.380574 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.380672 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.380882 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.380971 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.381191 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.381328 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.381502 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.381599 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.381805 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.381902 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.382112 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.382202 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.382418 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.382507 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.382718 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.382806 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.383039 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.383129 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.383364 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.383455 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.383672 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.383770 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.384511 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.384613 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.384819 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.384907 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.385131 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.385218 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.385439 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.385528 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.385864 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.385960 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.386180 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.386276 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.386493 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.386581 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.386801 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.386889 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.387108 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.387203 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.387445 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.387537 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.387763 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.387853 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.388075 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.388171 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.388377 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.388463 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.388790 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.388886 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.389101 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.389203 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.389410 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.389499 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.389723 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.389830 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.390023 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.390116 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.390321 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.390410 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.390628 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.390718 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.390965 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.391061 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.391248 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.391360 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.391571 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.391680 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.391870 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.391960 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.392185 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.392274 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.392485 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.392574 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.392801 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.392890 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.393210 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.393306 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.393516 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.393627 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.393817 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.393909 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.394221 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.394312 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.394525 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.394623 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.394833 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.394928 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.395149 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.395236 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.395491 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.395597 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.395813 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.395910 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.396114 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.396224 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.396426 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.396522 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.396729 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.396825 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.397050 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.397139 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.397368 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.397462 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.397674 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.397773 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.397984 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.398074 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.398284 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.398375 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.398600 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.398699 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.398917 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.399007 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.399228 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.399314 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.399597 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.399687 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.400045 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.400143 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.400371 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.400468 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.400690 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.400793 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.401012 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.401102 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.401338 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.401434 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.401645 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.401742 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.401956 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.402051 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.402263 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.402364 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.402565 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.402655 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.402867 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.402958 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.403185 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.403283 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.403511 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.403603 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.403822 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.403911 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.404132 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.404231 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.404436 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.404533 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.404737 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.404834 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.405038 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.405136 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.405356 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.405485 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.405660 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.405749 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.405978 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.406067 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.406289 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.406385 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.406611 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.406706 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.406929 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.407018 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.407230 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.407319 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.407570 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.407660 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.407879 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.407970 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.408181 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.408270 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.408482 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.408571 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.408785 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.408884 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.409126 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.409221 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.409425 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.409524 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.409743 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.409836 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.410068 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.410164 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.410393 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.410491 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.410700 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.410790 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.411029 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.411164 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.411375 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.411479 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.411692 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.411780 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.412006 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.412096 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.412329 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.412418 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.412628 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.412723 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.412928 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.413026 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.413234 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.413325 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.413538 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.413625 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.413836 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.413924 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.414136 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.414234 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.414440 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.414529 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.414736 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.414831 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.415035 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.415123 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.415879 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.415995 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.416197 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.416299 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.416496 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.416584 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.416816 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.416903 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.417119 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.417220 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.417422 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.417512 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.417723 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.417814 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.418026 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.418123 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.418364 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.418460 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.418661 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.418749 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.418990 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.419092 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.419304 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.419481 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.419645 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.419733 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.419972 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.420074 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.420281 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.420377 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.420601 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.420689 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.420919 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.421009 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.421231 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.421318 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.421545 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.421634 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.421858 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.421948 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.422169 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.422258 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.422517 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.422615 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.422795 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.422884 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.423100 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.423187 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.423436 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.423529 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.423752 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.423842 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.424067 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.424155 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.424580 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.424677 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.424909 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.424996 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.425217 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.425305 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.425527 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.425631 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.425834 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.425970 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.426146 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.426233 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.426454 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.426551 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.426764 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.426852 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.427068 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.427156 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.427398 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.427490 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.427709 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.427798 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.428034 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.428123 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.428352 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.428445 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.428672 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.428761 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.429003 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.429100 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.429315 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.429405 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.429628 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.429715 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.429938 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.430034 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.430251 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.430347 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.430601 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.430692 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.430966 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.431059 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.431276 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.431374 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.431613 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.431696 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.431926 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.432022 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.432236 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.432323 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.432546 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.432642 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.432855 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.432951 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.433165 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.433261 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.433475 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.433562 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.433779 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.433875 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.434084 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.434171 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.434394 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.434494 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.434705 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.434794 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.435026 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.435114 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.435388 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.435569 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.435696 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.435784 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.436007 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.436102 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.436319 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.436419 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.436629 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.436716 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.437149 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.437239 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.437462 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.437550 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.437791 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.437880 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.438115 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.438205 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.438436 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.438525 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.438748 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.438834 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.439063 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.439156 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.439409 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.439500 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.439717 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.439816 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.440016 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.440104 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.440326 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.440415 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.440631 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.440718 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.440932 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.441028 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.441249 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.441344 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.441557 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.441686 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.441860 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.441958 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.442176 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.442265 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.442479 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.442568 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.443010 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.443108 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.443376 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.443468 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.443694 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.443791 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.444019 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.444108 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.444342 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.444428 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.444656 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.444750 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.444961 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.445056 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.445283 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.445371 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.445589 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.445676 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.445894 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.445984 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.446205 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.446292 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.447069 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.447170 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.447411 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.447583 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.447711 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.447803 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.448019 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.448116 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.448328 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.448422 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.448630 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.448719 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.448939 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.449037 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.449245 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.449334 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.449573 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.449669 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.449879 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.449976 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.450183 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.450341 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.450485 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.450803 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.450897 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.451109 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.451309 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.451432 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.451733 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.451821 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.452036 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.452273 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.452365 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.452631 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.452754 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.452937 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.453225 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.453315 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.453532 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.453707 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.453833 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.454138 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.454235 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.454490 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.454810 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.454899 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.455114 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.455416 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.455522 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.455796 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.455958 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.456114 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.456436 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.456534 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.456798 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.457057 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.457148 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.457537 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.457626 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.457859 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.458132 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.458259 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.458570 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.458707 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.458892 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.459226 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.459571 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.459674 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.459891 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.459979 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.460227 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.460335 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.460555 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.460642 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.460894 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.461102 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.461201 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.461445 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.461535 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.461773 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.461900 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.462676 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.462783 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.463028 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.463116 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.463430 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.463511 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.463746 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.463853 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.464058 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.464147 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.464390 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.464481 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.464708 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.464805 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.465019 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.465109 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.465327 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.465417 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.465638 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.465728 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.465946 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.466035 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.466255 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.466387 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.466561 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.466651 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.466868 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.466957 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.467175 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.467263 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.467522 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.467614 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.467834 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.467922 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.468143 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.468308 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.468458 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.468546 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.468773 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.468860 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.469083 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.469179 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.469395 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.469491 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.469705 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.469802 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.470017 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.470115 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.470337 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.470426 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.470653 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.470740 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.470969 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.471059 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.471272 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.471394 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.471611 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.471746 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.471933 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.472030 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.472266 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.472607 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.472845 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.472934 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.473155 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.473244 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.473482 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.473609 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.473805 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.473910 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.474119 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.474208 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.474441 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.474536 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.474751 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.474853 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.475081 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.475171 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.475440 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.475543 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.475761 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.475864 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.476085 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.476172 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.476392 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.476490 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.476696 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.476791 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.477000 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.477090 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.477310 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.477400 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.477626 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.477736 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.477998 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.478131 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.478308 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.478440 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.478616 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.478744 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.478927 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.479055 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.479244 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.479381 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.479580 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.479692 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.479888 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.479989 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.480194 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.480310 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.480507 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.480596 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.480816 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.480905 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.481125 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.481224 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.481433 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.481521 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.481739 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.481827 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.482038 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.482139 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.482338 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.482474 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.482642 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.482737 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.482943 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.483082 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.483245 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.483382 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.483570 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.483659 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.483873 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.483968 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.484169 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.484257 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.484475 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.484563 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.484780 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.484871 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.485086 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.485175 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.485390 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.485485 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.485692 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.485782 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.486021 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.486110 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.486328 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.486425 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.486646 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.486739 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.486963 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.487053 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.487276 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.487423 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.487604 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.487700 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.487920 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.488007 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.488226 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.488327 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.488537 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.488627 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.488847 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.488938 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.489154 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.489250 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.489460 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.489548 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.489767 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.489863 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.490079 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.490176 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.490395 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.490494 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.490695 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.490783 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.491032 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.491129 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.491309 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.491428 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.491659 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.491749 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.491972 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.492061 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.492281 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.492378 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.492608 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.492696 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.492919 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.493016 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.493227 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.493343 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.493576 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.493663 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.493892 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.493994 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.494224 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.494314 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.494542 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.494640 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.494854 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.494950 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.495175 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.495263 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.495515 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.495624 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.495831 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.495929 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.496151 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.496246 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.496467 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.496565 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.496797 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.496886 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.497120 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.497209 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.497433 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.497523 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.497762 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.497851 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.498075 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.498169 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.498389 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.498480 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.498695 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.498785 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.498938 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 07 21:54:28.499062 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.499417 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.499739 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.500056 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.500364 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:54:28.500608 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 07 21:54:28.557608 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: INFO dbcounter [None req-7ce63515-6fb2-4e55-a6b7-f6a168a31e14 None None] Registered counter for database nova_api Jun 07 21:54:28.559531 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: INFO dbcounter [None req-999ec498-646a-41a6-9af4-029d47a69147 None None] Registered counter for database nova_api Jun 07 21:54:28.581054 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG oslo_db.sqlalchemy.engines [None req-7ce63515-6fb2-4e55-a6b7-f6a168a31e14 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103360) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 21:54:28.582492 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG oslo_db.sqlalchemy.engines [None req-999ec498-646a-41a6-9af4-029d47a69147 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103361) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 21:54:28.588029 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG dbcounter [-] [103360] Writer thread running {{(pid=103360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 21:54:28.589149 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG dbcounter [-] [103361] Writer thread running {{(pid=103361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 21:54:28.645872 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.context [None req-7ce63515-6fb2-4e55-a6b7-f6a168a31e14 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5130ba80-aa16-48e5-a7f8-322f7966dcb8(cell1) {{(pid=103360) load_cells /opt/stack/nova/nova/context.py:464}} Jun 07 21:54:28.646182 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.context [None req-999ec498-646a-41a6-9af4-029d47a69147 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5130ba80-aa16-48e5-a7f8-322f7966dcb8(cell1) {{(pid=103361) load_cells /opt/stack/nova/nova/context.py:464}} Jun 07 21:54:28.649998 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG oslo_concurrency.lockutils [None req-7ce63515-6fb2-4e55-a6b7-f6a168a31e14 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 21:54:28.650307 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG oslo_concurrency.lockutils [None req-999ec498-646a-41a6-9af4-029d47a69147 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 21:54:28.651588 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG oslo_concurrency.lockutils [None req-7ce63515-6fb2-4e55-a6b7-f6a168a31e14 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 21:54:28.651912 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG oslo_concurrency.lockutils [None req-999ec498-646a-41a6-9af4-029d47a69147 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 21:54:28.652361 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG oslo_concurrency.lockutils [None req-7ce63515-6fb2-4e55-a6b7-f6a168a31e14 None None] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 21:54:28.652693 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG oslo_concurrency.lockutils [None req-999ec498-646a-41a6-9af4-029d47a69147 None None] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 21:54:28.654290 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG oslo_concurrency.lockutils [None req-7ce63515-6fb2-4e55-a6b7-f6a168a31e14 None None] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 21:54:28.654651 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG oslo_concurrency.lockutils [None req-999ec498-646a-41a6-9af4-029d47a69147 None None] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 21:54:28.656261 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: INFO dbcounter [None req-7ce63515-6fb2-4e55-a6b7-f6a168a31e14 None None] Registered counter for database nova_cell0 Jun 07 21:54:28.656650 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: INFO dbcounter [None req-999ec498-646a-41a6-9af4-029d47a69147 None None] Registered counter for database nova_cell0 Jun 07 21:54:28.660284 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: INFO dbcounter [None req-7ce63515-6fb2-4e55-a6b7-f6a168a31e14 None None] Registered counter for database nova_cell1 Jun 07 21:54:28.660905 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: INFO dbcounter [None req-999ec498-646a-41a6-9af4-029d47a69147 None None] Registered counter for database nova_cell1 Jun 07 21:54:28.668542 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG oslo_db.sqlalchemy.engines [None req-7ce63515-6fb2-4e55-a6b7-f6a168a31e14 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103360) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 21:54:28.669817 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG oslo_db.sqlalchemy.engines [None req-7ce63515-6fb2-4e55-a6b7-f6a168a31e14 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103360) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 21:54:28.672265 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG oslo_db.sqlalchemy.engines [None req-999ec498-646a-41a6-9af4-029d47a69147 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103361) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 21:54:28.674884 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG oslo_db.sqlalchemy.engines [None req-999ec498-646a-41a6-9af4-029d47a69147 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103361) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 21:54:28.676300 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG dbcounter [-] [103360] Writer thread running {{(pid=103360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 21:54:28.678346 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG dbcounter [-] [103360] Writer thread running {{(pid=103360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 21:54:28.680195 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG dbcounter [-] [103361] Writer thread running {{(pid=103361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 21:54:28.823251 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG dbcounter [-] [103361] Writer thread running {{(pid=103361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 21:54:28.828323 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: INFO dbcounter [None req-7ce63515-6fb2-4e55-a6b7-f6a168a31e14 None None] Registered counter for database nova_cell0 Jun 07 21:54:28.833139 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: INFO dbcounter [None req-999ec498-646a-41a6-9af4-029d47a69147 None None] Registered counter for database nova_cell0 Jun 07 21:54:28.837626 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG oslo_db.sqlalchemy.engines [None req-7ce63515-6fb2-4e55-a6b7-f6a168a31e14 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103360) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 21:54:28.841751 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG oslo_db.sqlalchemy.engines [None req-999ec498-646a-41a6-9af4-029d47a69147 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103361) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 21:54:28.842190 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG dbcounter [-] [103360] Writer thread running {{(pid=103360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 21:54:28.846049 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG dbcounter [-] [103361] Writer thread running {{(pid=103361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 21:54:29.300326 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: WARNING keystonemiddleware.auth_token [None req-7ce63515-6fb2-4e55-a6b7-f6a168a31e14 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 07 21:54:29.304219 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: WARNING keystonemiddleware.auth_token [None req-999ec498-646a-41a6-9af4-029d47a69147 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 07 21:54:29.308047 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: WARNING keystonemiddleware.auth_token [None req-7ce63515-6fb2-4e55-a6b7-f6a168a31e14 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 07 21:54:29.311541 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: WARNING keystonemiddleware.auth_token [None req-999ec498-646a-41a6-9af4-029d47a69147 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 07 21:54:29.531543 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: WARNING keystonemiddleware.auth_token [None req-7ce63515-6fb2-4e55-a6b7-f6a168a31e14 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 07 21:54:29.537550 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: WARNING keystonemiddleware.auth_token [None req-7ce63515-6fb2-4e55-a6b7-f6a168a31e14 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 07 21:54:29.542339 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: WARNING keystonemiddleware.auth_token [None req-999ec498-646a-41a6-9af4-029d47a69147 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 07 21:54:29.542867 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5585946839c0 pid: 103360 (default app) Jun 07 21:54:29.546057 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-7ce63515-6fb2-4e55-a6b7-f6a168a31e14 None None] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 21:54:29.547234 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-7ce63515-6fb2-4e55-a6b7-f6a168a31e14 None None] 10.222.0.13 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002792 Jun 07 21:54:29.547674 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 1/1] 10.222.0.13 () {50 vars in 788 bytes} [Tue Jun 7 21:54:29 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 21:54:29.548358 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: WARNING keystonemiddleware.auth_token [None req-999ec498-646a-41a6-9af4-029d47a69147 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 07 21:54:29.553588 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5585946839c0 pid: 103361 (default app) Jun 07 21:55:48.697464 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-7ce63515-6fb2-4e55-a6b7-f6a168a31e14 None None] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 21:55:48.698464 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-7ce63515-6fb2-4e55-a6b7-f6a168a31e14 None None] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Jun 07 21:55:48.698877 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 2/2] 10.222.0.13 () {54 vars in 930 bytes} [Tue Jun 7 21:55:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 21:55:48.712192 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG dbcounter [-] [103361] Writing DB stats nova_api:SELECT=3 {{(pid=103361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:55:48.713330 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG dbcounter [-] [103361] Writing DB stats nova_cell0:SELECT=3 {{(pid=103361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:55:48.714346 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG dbcounter [-] [103361] Writing DB stats nova_cell1:SELECT=3 {{(pid=103361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:55:48.715081 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG dbcounter [-] [103361] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:55:49.185098 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-5dd89758-31a5-4d0d-a46e-4fc75b7fc441 admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 21:55:49.215926 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-5dd89758-31a5-4d0d-a46e-4fc75b7fc441 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.508933 Jun 07 21:55:49.219402 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 1/3] 10.222.0.13 () {60 vars in 1291 bytes} [Tue Jun 7 21:55:48 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 21:55:51.579020 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-7ce63515-6fb2-4e55-a6b7-f6a168a31e14 None None] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 21:55:51.580050 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-7ce63515-6fb2-4e55-a6b7-f6a168a31e14 None None] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Jun 07 21:55:51.580438 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 3/4] 10.222.0.13 () {54 vars in 930 bytes} [Tue Jun 7 21:55:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 21:55:51.643690 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-dcbf1bb0-1ef8-47eb-a344-47d6897b7995 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "c1", "vcpus": 1, "disk": 1, "swap": 0}} {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 21:55:51.662194 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 21:55:51.662194 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: warnings.warn(msg) Jun 07 21:55:51.693559 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-dcbf1bb0-1ef8-47eb-a344-47d6897b7995 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.106975 Jun 07 21:55:51.694684 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 2/5] 10.222.0.13 () {64 vars in 1282 bytes} [Tue Jun 7 21:55:51 2022] POST /compute/v2.1/flavors => generated 407 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 21:55:51.707958 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG dbcounter [-] [103360] Writing DB stats nova_api:SELECT=3 {{(pid=103360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:55:51.709105 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG dbcounter [-] [103360] Writing DB stats nova_cell0:SELECT=3 {{(pid=103360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:55:51.709868 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG dbcounter [-] [103360] Writing DB stats nova_cell1:SELECT=3 {{(pid=103360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:55:51.711455 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG dbcounter [-] [103360] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:55:51.922560 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-49c3c450-4770-4cf6-9e6d-2b3a5e7330c5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 21:55:51.925047 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 21:55:51.925047 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: warnings.warn(msg) Jun 07 21:55:51.993225 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-49c3c450-4770-4cf6-9e6d-2b3a5e7330c5 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.290246 Jun 07 21:55:51.994052 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 4/6] 10.222.0.13 () {64 vars in 1335 bytes} [Tue Jun 7 21:55:51 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 21:55:54.369106 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-dcbf1bb0-1ef8-47eb-a344-47d6897b7995 admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 21:55:54.370244 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-dcbf1bb0-1ef8-47eb-a344-47d6897b7995 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001580 Jun 07 21:55:54.370738 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 3/7] 10.222.0.13 () {54 vars in 930 bytes} [Tue Jun 7 21:55:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 21:55:54.473992 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-01a9a167-064e-4c71-a2ce-dd0d58c67bfe admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 5, "vcpus": 1, "swap": 0, "id": "d1", "ram": 512}} {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 21:55:54.492584 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 21:55:54.492584 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: warnings.warn(msg) Jun 07 21:55:54.510625 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-01a9a167-064e-4c71-a2ce-dd0d58c67bfe admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.133941 Jun 07 21:55:54.511176 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 5/8] 10.222.0.13 () {64 vars in 1282 bytes} [Tue Jun 7 21:55:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 21:55:54.523613 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-ce03bad8-9891-420b-b4f0-d1cbdc89c1fe admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 21:55:54.525002 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 21:55:54.525002 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: warnings.warn(msg) Jun 07 21:55:54.557561 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-ce03bad8-9891-420b-b4f0-d1cbdc89c1fe admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038193 Jun 07 21:55:54.558072 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 4/9] 10.222.0.13 () {64 vars in 1335 bytes} [Tue Jun 7 21:55:54 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 21:55:56.880660 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-01a9a167-064e-4c71-a2ce-dd0d58c67bfe admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 21:55:56.882316 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-01a9a167-064e-4c71-a2ce-dd0d58c67bfe admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Jun 07 21:55:56.883052 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 6/10] 10.222.0.13 () {54 vars in 930 bytes} [Tue Jun 7 21:55:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 21:55:56.942186 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-1f10741b-7eb9-47ad-b3ae-78de4fdd3eee admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "id": "d2", "swap": 0, "os-flavor-access:is_public": true, "disk": 10}} {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 21:55:56.963658 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-1f10741b-7eb9-47ad-b3ae-78de4fdd3eee admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074548 Jun 07 21:55:56.964363 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 5/11] 10.222.0.13 () {64 vars in 1282 bytes} [Tue Jun 7 21:55:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 21:55:56.976415 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-3e694080-6799-422e-b79b-eb0b8af37395 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 21:55:57.000339 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-3e694080-6799-422e-b79b-eb0b8af37395 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028063 Jun 07 21:55:57.000921 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 7/12] 10.222.0.13 () {64 vars in 1335 bytes} [Tue Jun 7 21:55:56 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 21:55:59.309944 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-1f10741b-7eb9-47ad-b3ae-78de4fdd3eee admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 21:55:59.310962 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-1f10741b-7eb9-47ad-b3ae-78de4fdd3eee admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Jun 07 21:55:59.311535 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 6/13] 10.222.0.13 () {54 vars in 930 bytes} [Tue Jun 7 21:55:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 21:55:59.375271 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-9c935645-18e5-4675-8387-da8f9932ba6a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 2048, "rxtx_factor": 1.0, "swap": 0, "id": "d3", "vcpus": 2}} {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 21:55:59.394327 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-9c935645-18e5-4675-8387-da8f9932ba6a admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.077186 Jun 07 21:55:59.394904 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 8/14] 10.222.0.13 () {64 vars in 1282 bytes} [Tue Jun 7 21:55:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 21:55:59.407926 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-14a9c0aa-cc19-4f5e-b1f6-f8ae1a36f6ff admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 21:55:59.433760 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-14a9c0aa-cc19-4f5e-b1f6-f8ae1a36f6ff admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029434 Jun 07 21:55:59.434358 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 7/15] 10.222.0.13 () {64 vars in 1335 bytes} [Tue Jun 7 21:55:59 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 21:56:01.812048 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-9c935645-18e5-4675-8387-da8f9932ba6a admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 21:56:01.813059 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-9c935645-18e5-4675-8387-da8f9932ba6a admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Jun 07 21:56:01.813478 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 9/16] 10.222.0.13 () {54 vars in 930 bytes} [Tue Jun 7 21:56:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 21:56:01.873966 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-2b1a0961-0b6d-423d-8850-d95bfabdf909 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 4, "rxtx_factor": 1.0, "name": "ds4G", "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 4096, "id": "d4"}} {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 21:56:01.892361 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-2b1a0961-0b6d-423d-8850-d95bfabdf909 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.072991 Jun 07 21:56:01.899386 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 8/17] 10.222.0.13 () {64 vars in 1282 bytes} [Tue Jun 7 21:56:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 21:56:01.905578 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-586e7131-7647-46a9-b675-aa0bcf9357bd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 21:56:01.929422 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-586e7131-7647-46a9-b675-aa0bcf9357bd admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027543 Jun 07 21:56:01.930151 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 10/18] 10.222.0.13 () {64 vars in 1335 bytes} [Tue Jun 7 21:56:01 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 21:56:04.262441 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-2b1a0961-0b6d-423d-8850-d95bfabdf909 admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 21:56:04.263528 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-2b1a0961-0b6d-423d-8850-d95bfabdf909 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Jun 07 21:56:04.263934 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 9/19] 10.222.0.13 () {54 vars in 930 bytes} [Tue Jun 7 21:56:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 21:56:04.330033 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-58f8e53b-ab5e-4a25-b53f-a616929efb75 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 21:56:04.354866 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-58f8e53b-ab5e-4a25-b53f-a616929efb75 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.084766 Jun 07 21:56:04.355776 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 11/20] 10.222.0.13 () {60 vars in 1291 bytes} [Tue Jun 7 21:56:04 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 21:56:06.923537 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-2b1a0961-0b6d-423d-8850-d95bfabdf909 admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 21:56:06.924593 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-2b1a0961-0b6d-423d-8850-d95bfabdf909 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 Jun 07 21:56:06.925001 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 10/21] 10.222.0.13 () {54 vars in 930 bytes} [Tue Jun 7 21:56:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 21:56:06.985959 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-47f76b65-1432-43d2-a562-f54b02d43e87 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "disk": 1, "os-flavor-access:is_public": true, "ram": 512, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1"}} {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 21:56:07.004475 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-47f76b65-1432-43d2-a562-f54b02d43e87 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.073271 Jun 07 21:56:07.005029 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 12/22] 10.222.0.13 () {64 vars in 1282 bytes} [Tue Jun 7 21:56:06 2022] POST /compute/v2.1/flavors => generated 402 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 21:56:07.017594 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-bcbdc44e-2471-4016-8bc7-237b834708b2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 21:56:07.041139 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-bcbdc44e-2471-4016-8bc7-237b834708b2 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027257 Jun 07 21:56:07.041736 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 11/23] 10.222.0.13 () {64 vars in 1332 bytes} [Tue Jun 7 21:56:07 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 21:56:10.013674 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-47f76b65-1432-43d2-a562-f54b02d43e87 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 21:56:10.014694 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-47f76b65-1432-43d2-a562-f54b02d43e87 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Jun 07 21:56:10.015095 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 13/24] 10.222.0.13 () {54 vars in 930 bytes} [Tue Jun 7 21:56:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 21:56:10.081481 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-48b52150-e976-47ba-b20b-649554ab391f admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "m1.small", "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "ram": 2048, "rxtx_factor": 1.0, "id": "2"}} {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 21:56:10.102389 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-48b52150-e976-47ba-b20b-649554ab391f admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.081257 Jun 07 21:56:10.102953 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 12/25] 10.222.0.13 () {64 vars in 1282 bytes} [Tue Jun 7 21:56:10 2022] POST /compute/v2.1/flavors => generated 405 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 21:56:10.114790 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-1bd8ca64-acc3-48b4-8d7f-7199b8ba9881 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 21:56:10.141845 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-1bd8ca64-acc3-48b4-8d7f-7199b8ba9881 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030600 Jun 07 21:56:10.142434 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 14/26] 10.222.0.13 () {64 vars in 1332 bytes} [Tue Jun 7 21:56:10 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 21:56:12.679843 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-48b52150-e976-47ba-b20b-649554ab391f admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 21:56:12.680891 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-48b52150-e976-47ba-b20b-649554ab391f admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001530 Jun 07 21:56:12.681294 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 13/27] 10.222.0.13 () {54 vars in 930 bytes} [Tue Jun 7 21:56:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 21:56:12.738075 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-8cc102e8-38c1-4570-ab97-2d79514b627e admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "vcpus": 2, "id": "3", "rxtx_factor": 1.0, "disk": 40, "ram": 4096, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 21:56:12.755452 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-8cc102e8-38c1-4570-ab97-2d79514b627e admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.068292 Jun 07 21:56:12.763626 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 15/28] 10.222.0.13 () {64 vars in 1282 bytes} [Tue Jun 7 21:56:12 2022] POST /compute/v2.1/flavors => generated 406 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 21:56:12.768676 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-196567bc-6b34-40e2-a2b8-a9423b3766b4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 21:56:12.791415 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-196567bc-6b34-40e2-a2b8-a9423b3766b4 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026453 Jun 07 21:56:12.792093 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 14/29] 10.222.0.13 () {64 vars in 1332 bytes} [Tue Jun 7 21:56:12 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 21:56:15.105923 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-8cc102e8-38c1-4570-ab97-2d79514b627e admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 21:56:15.107544 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-8cc102e8-38c1-4570-ab97-2d79514b627e admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002029 Jun 07 21:56:15.108120 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 16/30] 10.222.0.13 () {54 vars in 930 bytes} [Tue Jun 7 21:56:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 21:56:15.171826 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-48e2d686-aa25-46e8-8bc8-1c49a6aee892 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "swap": 0, "name": "m1.large", "id": "4", "vcpus": 4, "os-flavor-access:is_public": true, "ram": 8192, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 21:56:15.190826 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-48e2d686-aa25-46e8-8bc8-1c49a6aee892 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.076769 Jun 07 21:56:15.191768 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 15/31] 10.222.0.13 () {64 vars in 1282 bytes} [Tue Jun 7 21:56:15 2022] POST /compute/v2.1/flavors => generated 405 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 21:56:15.205577 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-eb7f2651-ee77-47c4-9df2-ee70f66cf847 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 21:56:15.231568 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-eb7f2651-ee77-47c4-9df2-ee70f66cf847 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030183 Jun 07 21:56:15.239938 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 17/32] 10.222.0.13 () {64 vars in 1332 bytes} [Tue Jun 7 21:56:15 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 21:56:17.621976 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-48e2d686-aa25-46e8-8bc8-1c49a6aee892 admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 21:56:17.622997 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-48e2d686-aa25-46e8-8bc8-1c49a6aee892 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Jun 07 21:56:17.623698 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 16/33] 10.222.0.13 () {54 vars in 930 bytes} [Tue Jun 7 21:56:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 21:56:17.693545 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-3d9ae485-d4d2-4a85-a260-ea52c05f75a1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "ram": 16384, "swap": 0, "disk": 160, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "5", "rxtx_factor": 1.0}} {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 21:56:17.713867 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-3d9ae485-d4d2-4a85-a260-ea52c05f75a1 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.084089 Jun 07 21:56:17.714419 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 18/34] 10.222.0.13 () {64 vars in 1282 bytes} [Tue Jun 7 21:56:17 2022] POST /compute/v2.1/flavors => generated 408 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 21:56:17.727202 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-1c7e76f8-7fdc-4ea6-941e-2a9ea7738035 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 21:56:17.754410 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-1c7e76f8-7fdc-4ea6-941e-2a9ea7738035 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031989 Jun 07 21:56:17.755125 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 17/35] 10.222.0.13 () {64 vars in 1332 bytes} [Tue Jun 7 21:56:17 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 21:56:41.438910 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-3d9ae485-d4d2-4a85-a260-ea52c05f75a1 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 21:56:41.439967 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-3d9ae485-d4d2-4a85-a260-ea52c05f75a1 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Jun 07 21:56:41.440368 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 19/36] 10.222.0.13 () {54 vars in 930 bytes} [Tue Jun 7 21:56:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 21:56:41.450923 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG dbcounter [-] [103361] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:56:41.502717 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-47b141f8-3051-4c68-a581-4387c3496316 admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 21:56:41.520556 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-47b141f8-3051-4c68-a581-4387c3496316 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.074179 Jun 07 21:56:41.521622 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 18/37] 10.222.0.13 () {60 vars in 1291 bytes} [Tue Jun 7 21:56:41 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 21:56:42.528190 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-3d9ae485-d4d2-4a85-a260-ea52c05f75a1 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 21:56:42.529189 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-3d9ae485-d4d2-4a85-a260-ea52c05f75a1 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Jun 07 21:56:42.529582 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 20/38] 10.222.0.13 () {56 vars in 1074 bytes} [Tue Jun 7 21:56:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 21:56:42.729874 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-2ed59328-b446-4a37-a034-2239bb2fbacd admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 21:56:42.735574 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.wsgi [None req-2ed59328-b446-4a37-a034-2239bb2fbacd admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 07 21:56:42.738824 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-2ed59328-b446-4a37-a034-2239bb2fbacd admin admin] Request method failure captured: Jun 07 21:56:42.738824 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 07 21:56:42.738824 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: Accept: application/json Jun 07 21:56:42.738824 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: Accept-Encoding: gzip, deflate Jun 07 21:56:42.738824 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: Connection: keep-alive Jun 07 21:56:42.738824 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: Content-Length: 0 Jun 07 21:56:42.738824 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: Host: 10.222.0.13 Jun 07 21:56:42.738824 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: Openstack-Api-Version: compute 2.90 Jun 07 21:56:42.738824 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: Openstack-System-Scope: None Jun 07 21:56:42.738824 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: User-Agent: python-novaclient Jun 07 21:56:42.738824 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: X-Auth-Token: gAAAAABin8maMJ79wNUuyZeEnaGWfHqFU--J9TG4mEjsZpt8F28ze_FIzKFzleD7c46rhm6qyFqwBhg6kDh-72QYj7a7kB8ffybVWkVoUoevApbAcX1sKpH-fepdiJqQgr9cVxIyzXnoCYcyjhGUAOxpiWNYTdsGjKn3uP97O1RMgLS6VdyfOB0 Jun 07 21:56:42.738824 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: X-Domain-Id: None Jun 07 21:56:42.738824 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: X-Domain-Name: None Jun 07 21:56:42.738824 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: X-Identity-Status: Confirmed Jun 07 21:56:42.738824 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: X-Is-Admin-Project: True Jun 07 21:56:42.738824 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: X-Openstack-Nova-Api-Version: 2.90 Jun 07 21:56:42.738824 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: X-Project-Domain-Id: default Jun 07 21:56:42.738824 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: X-Project-Domain-Name: Default Jun 07 21:56:42.738824 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: X-Project-Id: c61211fad6e447b0bf162f99f1111a82 Jun 07 21:56:42.738824 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: X-Project-Name: admin Jun 07 21:56:42.738824 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: X-Role: admin,member,reader Jun 07 21:56:42.738824 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: X-Roles: admin,member,reader Jun 07 21:56:42.740805 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c61211fad6e447b0bf162f99f1111a82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c61211fad6e447b0bf162f99f1111a82"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c61211fad6e447b0bf162f99f1111a82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c61211fad6e447b0bf162f99f1111a82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}] Jun 07 21:56:42.740805 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: X-Tenant: admin Jun 07 21:56:42.740805 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: X-Tenant-Id: c61211fad6e447b0bf162f99f1111a82 Jun 07 21:56:42.740805 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: X-Tenant-Name: admin Jun 07 21:56:42.740805 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: X-User: admin Jun 07 21:56:42.740805 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: X-User-Domain-Id: default Jun 07 21:56:42.740805 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: X-User-Domain-Name: Default Jun 07 21:56:42.740805 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: X-User-Id: c9d023b1a9bd4c969261ea4adeb6b556 Jun 07 21:56:42.740805 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: X-User-Name: admin Jun 07 21:56:42.740805 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: method: > Jun 07 21:56:42.740805 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: exception: Flavor 42 could not be found. Jun 07 21:56:42.740805 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: action_args: {'id': '42'} Jun 07 21:56:42.740805 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 21:56:42.740805 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 21:56:42.741912 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 07 21:56:42.741912 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 07 21:56:42.741912 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 07 21:56:42.741912 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 07 21:56:42.741912 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 07 21:56:42.741912 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 07 21:56:42.741912 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 07 21:56:42.741912 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 07 21:56:42.741912 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 07 21:56:42.741912 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 21:56:42.741912 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 07 21:56:42.741912 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 07 21:56:42.741912 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 07 21:56:42.741912 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Jun 07 21:56:42.741912 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 21:56:42.741912 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Jun 07 21:56:42.741912 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 21:56:42.741912 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 21:56:42.741912 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 21:56:42.743368 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 21:56:42.743368 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 21:56:42.743368 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 21:56:42.743368 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 21:56:42.743368 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 07 21:56:42.743368 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 07 21:56:42.743368 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 07 21:56:42.743368 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Jun 07 21:56:42.743368 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 21:56:42.743368 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Jun 07 21:56:42.743368 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 21:56:42.743368 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 21:56:42.743368 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 21:56:42.743368 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 21:56:42.743368 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 21:56:42.743368 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 07 21:56:42.743368 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Jun 07 21:56:42.743368 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-2ed59328-b446-4a37-a034-2239bb2fbacd admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 21:56:42.744642 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-2ed59328-b446-4a37-a034-2239bb2fbacd admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.061884 Jun 07 21:56:42.744642 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 19/39] 10.222.0.13 () {60 vars in 1190 bytes} [Tue Jun 7 21:56:42 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 07 21:56:42.749908 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-bf3cb03c-4637-4512-bf56-2e8b1b59f9c4 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 21:56:42.752940 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG dbcounter [-] [103360] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:56:42.775199 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-bf3cb03c-4637-4512-bf56-2e8b1b59f9c4 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028770 Jun 07 21:56:42.775785 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 21/40] 10.222.0.13 () {60 vars in 1210 bytes} [Tue Jun 7 21:56:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 21:56:42.796348 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-b7d0917c-da86-4bb7-877c-8fe63a761d3e admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 21:56:42.817063 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-b7d0917c-da86-4bb7-877c-8fe63a761d3e admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024309 Jun 07 21:56:42.817595 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 20/41] 10.222.0.13 () {60 vars in 1210 bytes} [Tue Jun 7 21:56:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 21:56:42.829147 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-c46244db-828a-4338-91ff-57f2193931a1 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 21:56:42.836869 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.wsgi [None req-c46244db-828a-4338-91ff-57f2193931a1 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 07 21:56:42.840113 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-c46244db-828a-4338-91ff-57f2193931a1 admin admin] Request method failure captured: Jun 07 21:56:42.840113 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 07 21:56:42.840113 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: Accept: application/json Jun 07 21:56:42.840113 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: Accept-Encoding: gzip, deflate Jun 07 21:56:42.840113 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: Connection: keep-alive Jun 07 21:56:42.840113 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: Content-Length: 0 Jun 07 21:56:42.840113 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: Host: 10.222.0.13 Jun 07 21:56:42.840113 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: Openstack-Api-Version: compute 2.90 Jun 07 21:56:42.840113 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: Openstack-System-Scope: None Jun 07 21:56:42.840113 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: User-Agent: python-novaclient Jun 07 21:56:42.840113 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: X-Auth-Token: gAAAAABin8maMJ79wNUuyZeEnaGWfHqFU--J9TG4mEjsZpt8F28ze_FIzKFzleD7c46rhm6qyFqwBhg6kDh-72QYj7a7kB8ffybVWkVoUoevApbAcX1sKpH-fepdiJqQgr9cVxIyzXnoCYcyjhGUAOxpiWNYTdsGjKn3uP97O1RMgLS6VdyfOB0 Jun 07 21:56:42.840113 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: X-Domain-Id: None Jun 07 21:56:42.840113 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: X-Domain-Name: None Jun 07 21:56:42.840113 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: X-Identity-Status: Confirmed Jun 07 21:56:42.840113 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: X-Is-Admin-Project: True Jun 07 21:56:42.840113 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: X-Openstack-Nova-Api-Version: 2.90 Jun 07 21:56:42.840113 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: X-Project-Domain-Id: default Jun 07 21:56:42.840113 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: X-Project-Domain-Name: Default Jun 07 21:56:42.840113 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: X-Project-Id: c61211fad6e447b0bf162f99f1111a82 Jun 07 21:56:42.840113 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: X-Project-Name: admin Jun 07 21:56:42.840113 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: X-Role: admin,member,reader Jun 07 21:56:42.840113 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: X-Roles: admin,member,reader Jun 07 21:56:42.841655 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c61211fad6e447b0bf162f99f1111a82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c61211fad6e447b0bf162f99f1111a82"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c61211fad6e447b0bf162f99f1111a82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c61211fad6e447b0bf162f99f1111a82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}] Jun 07 21:56:42.841655 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: X-Tenant: admin Jun 07 21:56:42.841655 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: X-Tenant-Id: c61211fad6e447b0bf162f99f1111a82 Jun 07 21:56:42.841655 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: X-Tenant-Name: admin Jun 07 21:56:42.841655 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: X-User: admin Jun 07 21:56:42.841655 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: X-User-Domain-Id: default Jun 07 21:56:42.841655 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: X-User-Domain-Name: Default Jun 07 21:56:42.841655 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: X-User-Id: c9d023b1a9bd4c969261ea4adeb6b556 Jun 07 21:56:42.841655 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: X-User-Name: admin Jun 07 21:56:42.841655 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: method: > Jun 07 21:56:42.841655 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: exception: Flavor 42 could not be found. Jun 07 21:56:42.841655 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: action_args: {'id': '42'} Jun 07 21:56:42.841655 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 21:56:42.841655 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 21:56:42.842685 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 07 21:56:42.842685 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 07 21:56:42.842685 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 07 21:56:42.842685 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 07 21:56:42.842685 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 07 21:56:42.842685 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 07 21:56:42.842685 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 07 21:56:42.842685 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 07 21:56:42.842685 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 07 21:56:42.842685 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 21:56:42.842685 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 07 21:56:42.842685 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 07 21:56:42.842685 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 07 21:56:42.842685 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Jun 07 21:56:42.842685 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 21:56:42.842685 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Jun 07 21:56:42.842685 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 21:56:42.842685 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 21:56:42.842685 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 21:56:42.843807 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 21:56:42.843807 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 21:56:42.843807 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 21:56:42.843807 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 21:56:42.843807 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 07 21:56:42.843807 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 07 21:56:42.843807 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 07 21:56:42.843807 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Jun 07 21:56:42.843807 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 21:56:42.843807 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Jun 07 21:56:42.843807 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 21:56:42.843807 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 21:56:42.843807 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 21:56:42.843807 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 21:56:42.843807 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 21:56:42.843807 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 07 21:56:42.843807 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Jun 07 21:56:42.843807 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-c46244db-828a-4338-91ff-57f2193931a1 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 21:56:42.844773 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-c46244db-828a-4338-91ff-57f2193931a1 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015907 Jun 07 21:56:42.844773 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 22/42] 10.222.0.13 () {60 vars in 1190 bytes} [Tue Jun 7 21:56:42 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 07 21:56:43.731854 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-b7d0917c-da86-4bb7-877c-8fe63a761d3e admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 21:56:43.732925 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-b7d0917c-da86-4bb7-877c-8fe63a761d3e admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Jun 07 21:56:43.733321 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 21/43] 10.222.0.13 () {56 vars in 1074 bytes} [Tue Jun 7 21:56:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 21:56:43.921896 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-c8ce9201-c2b0-4c6f-b9bc-346a897a1ecf admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 21:56:43.927741 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.wsgi [None req-c8ce9201-c2b0-4c6f-b9bc-346a897a1ecf admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 07 21:56:43.929247 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-c8ce9201-c2b0-4c6f-b9bc-346a897a1ecf admin admin] Request method failure captured: Jun 07 21:56:43.929247 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 07 21:56:43.929247 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: Accept: application/json Jun 07 21:56:43.929247 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: Accept-Encoding: gzip, deflate Jun 07 21:56:43.929247 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: Connection: keep-alive Jun 07 21:56:43.929247 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: Content-Length: 0 Jun 07 21:56:43.929247 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: Host: 10.222.0.13 Jun 07 21:56:43.929247 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: Openstack-Api-Version: compute 2.90 Jun 07 21:56:43.929247 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: Openstack-System-Scope: None Jun 07 21:56:43.929247 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: User-Agent: python-novaclient Jun 07 21:56:43.929247 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: X-Auth-Token: gAAAAABin8mbrhM6wlqkJyRNiGJTD-39QHr8k-n1_1QQOfQ08Xh14Xw52cAH8HUgBPqQiyQRs-pjYuXX19LnIfu2_ecLVxbVJ6MztS67E3hqrOknHNfu-LihugAl7AL6Tw5NO9MNz2l-cg2ZKGHcf1hriH-csaqXZTMgoOjqhe8q0Dq0nE-GRe0 Jun 07 21:56:43.929247 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: X-Domain-Id: None Jun 07 21:56:43.929247 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: X-Domain-Name: None Jun 07 21:56:43.929247 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: X-Identity-Status: Confirmed Jun 07 21:56:43.929247 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: X-Is-Admin-Project: True Jun 07 21:56:43.929247 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: X-Openstack-Nova-Api-Version: 2.90 Jun 07 21:56:43.929247 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: X-Project-Domain-Id: default Jun 07 21:56:43.929247 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: X-Project-Domain-Name: Default Jun 07 21:56:43.929247 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: X-Project-Id: c61211fad6e447b0bf162f99f1111a82 Jun 07 21:56:43.929247 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: X-Project-Name: admin Jun 07 21:56:43.929247 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: X-Role: admin,member,reader Jun 07 21:56:43.929247 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: X-Roles: admin,member,reader Jun 07 21:56:43.930730 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c61211fad6e447b0bf162f99f1111a82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c61211fad6e447b0bf162f99f1111a82"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c61211fad6e447b0bf162f99f1111a82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c61211fad6e447b0bf162f99f1111a82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}] Jun 07 21:56:43.930730 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: X-Tenant: admin Jun 07 21:56:43.930730 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: X-Tenant-Id: c61211fad6e447b0bf162f99f1111a82 Jun 07 21:56:43.930730 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: X-Tenant-Name: admin Jun 07 21:56:43.930730 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: X-User: admin Jun 07 21:56:43.930730 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: X-User-Domain-Id: default Jun 07 21:56:43.930730 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: X-User-Domain-Name: Default Jun 07 21:56:43.930730 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: X-User-Id: c9d023b1a9bd4c969261ea4adeb6b556 Jun 07 21:56:43.930730 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: X-User-Name: admin Jun 07 21:56:43.930730 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: method: > Jun 07 21:56:43.930730 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: exception: Flavor 84 could not be found. Jun 07 21:56:43.930730 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: action_args: {'id': '84'} Jun 07 21:56:43.930730 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 21:56:43.930730 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 21:56:43.931805 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 07 21:56:43.931805 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 07 21:56:43.931805 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 07 21:56:43.931805 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 07 21:56:43.931805 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 07 21:56:43.931805 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 07 21:56:43.931805 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 07 21:56:43.931805 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 07 21:56:43.931805 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 07 21:56:43.931805 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 21:56:43.931805 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 07 21:56:43.931805 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 07 21:56:43.931805 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 07 21:56:43.931805 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Jun 07 21:56:43.931805 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 21:56:43.931805 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Jun 07 21:56:43.931805 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 21:56:43.931805 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 21:56:43.931805 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 21:56:43.933193 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 21:56:43.933193 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 21:56:43.933193 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 21:56:43.933193 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 21:56:43.933193 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 07 21:56:43.933193 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 07 21:56:43.933193 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 07 21:56:43.933193 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Jun 07 21:56:43.933193 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 21:56:43.933193 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Jun 07 21:56:43.933193 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 21:56:43.933193 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 21:56:43.933193 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 21:56:43.933193 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 21:56:43.933193 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 21:56:43.933193 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 07 21:56:43.933193 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Jun 07 21:56:43.933193 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-c8ce9201-c2b0-4c6f-b9bc-346a897a1ecf admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 21:56:43.934521 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-c8ce9201-c2b0-4c6f-b9bc-346a897a1ecf admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.060947 Jun 07 21:56:43.934521 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 23/44] 10.222.0.13 () {60 vars in 1190 bytes} [Tue Jun 7 21:56:43 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 07 21:56:43.940366 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-0e7c0e55-6e9a-43ce-80bf-9d44919faf0b admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 21:56:43.954423 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-0e7c0e55-6e9a-43ce-80bf-9d44919faf0b admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017764 Jun 07 21:56:43.954943 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 22/45] 10.222.0.13 () {60 vars in 1210 bytes} [Tue Jun 7 21:56:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 21:56:43.964052 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-3741370b-57dd-4990-8d78-4b509b3f7a47 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 21:56:43.977626 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-3741370b-57dd-4990-8d78-4b509b3f7a47 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017088 Jun 07 21:56:43.978148 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 24/46] 10.222.0.13 () {60 vars in 1210 bytes} [Tue Jun 7 21:56:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 21:56:43.987079 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-4139f06e-f847-49a3-9a40-76bb518089e1 admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 21:56:43.992962 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.wsgi [None req-4139f06e-f847-49a3-9a40-76bb518089e1 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 07 21:56:43.994444 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-4139f06e-f847-49a3-9a40-76bb518089e1 admin admin] Request method failure captured: Jun 07 21:56:43.994444 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 07 21:56:43.994444 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: Accept: application/json Jun 07 21:56:43.994444 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: Accept-Encoding: gzip, deflate Jun 07 21:56:43.994444 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: Connection: keep-alive Jun 07 21:56:43.994444 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: Content-Length: 0 Jun 07 21:56:43.994444 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: Host: 10.222.0.13 Jun 07 21:56:43.994444 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: Openstack-Api-Version: compute 2.90 Jun 07 21:56:43.994444 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: Openstack-System-Scope: None Jun 07 21:56:43.994444 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: User-Agent: python-novaclient Jun 07 21:56:43.994444 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: X-Auth-Token: gAAAAABin8mbrhM6wlqkJyRNiGJTD-39QHr8k-n1_1QQOfQ08Xh14Xw52cAH8HUgBPqQiyQRs-pjYuXX19LnIfu2_ecLVxbVJ6MztS67E3hqrOknHNfu-LihugAl7AL6Tw5NO9MNz2l-cg2ZKGHcf1hriH-csaqXZTMgoOjqhe8q0Dq0nE-GRe0 Jun 07 21:56:43.994444 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: X-Domain-Id: None Jun 07 21:56:43.994444 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: X-Domain-Name: None Jun 07 21:56:43.994444 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: X-Identity-Status: Confirmed Jun 07 21:56:43.994444 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: X-Is-Admin-Project: True Jun 07 21:56:43.994444 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: X-Openstack-Nova-Api-Version: 2.90 Jun 07 21:56:43.994444 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: X-Project-Domain-Id: default Jun 07 21:56:43.994444 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: X-Project-Domain-Name: Default Jun 07 21:56:43.994444 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: X-Project-Id: c61211fad6e447b0bf162f99f1111a82 Jun 07 21:56:43.994444 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: X-Project-Name: admin Jun 07 21:56:43.994444 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: X-Role: admin,member,reader Jun 07 21:56:43.994444 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: X-Roles: admin,member,reader Jun 07 21:56:43.995884 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c61211fad6e447b0bf162f99f1111a82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c61211fad6e447b0bf162f99f1111a82"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c61211fad6e447b0bf162f99f1111a82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c61211fad6e447b0bf162f99f1111a82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}] Jun 07 21:56:43.995884 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: X-Tenant: admin Jun 07 21:56:43.995884 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: X-Tenant-Id: c61211fad6e447b0bf162f99f1111a82 Jun 07 21:56:43.995884 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: X-Tenant-Name: admin Jun 07 21:56:43.995884 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: X-User: admin Jun 07 21:56:43.995884 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: X-User-Domain-Id: default Jun 07 21:56:43.995884 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: X-User-Domain-Name: Default Jun 07 21:56:43.995884 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: X-User-Id: c9d023b1a9bd4c969261ea4adeb6b556 Jun 07 21:56:43.995884 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: X-User-Name: admin Jun 07 21:56:43.995884 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: method: > Jun 07 21:56:43.995884 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: exception: Flavor 84 could not be found. Jun 07 21:56:43.995884 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: action_args: {'id': '84'} Jun 07 21:56:43.995884 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 21:56:43.995884 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 21:56:43.996727 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 07 21:56:43.996727 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 07 21:56:43.996727 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 07 21:56:43.996727 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 07 21:56:43.996727 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 07 21:56:43.996727 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 07 21:56:43.996727 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 07 21:56:43.996727 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 07 21:56:43.996727 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 07 21:56:43.996727 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 21:56:43.996727 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 07 21:56:43.996727 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 07 21:56:43.996727 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 07 21:56:43.996727 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Jun 07 21:56:43.996727 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 21:56:43.996727 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Jun 07 21:56:43.996727 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 21:56:43.996727 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 21:56:43.996727 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 21:56:43.997904 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 21:56:43.997904 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 21:56:43.997904 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 21:56:43.997904 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 21:56:43.997904 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 07 21:56:43.997904 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 07 21:56:43.997904 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 07 21:56:43.997904 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Jun 07 21:56:43.997904 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 21:56:43.997904 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Jun 07 21:56:43.997904 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 21:56:43.997904 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 21:56:43.997904 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 21:56:43.997904 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 21:56:43.997904 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 21:56:43.997904 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 07 21:56:43.997904 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Jun 07 21:56:43.997904 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-4139f06e-f847-49a3-9a40-76bb518089e1 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 21:56:43.998992 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-4139f06e-f847-49a3-9a40-76bb518089e1 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012196 Jun 07 21:56:43.998992 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 23/47] 10.222.0.13 () {60 vars in 1190 bytes} [Tue Jun 7 21:56:43 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 07 21:56:44.862877 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-3741370b-57dd-4990-8d78-4b509b3f7a47 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 21:56:44.863924 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-3741370b-57dd-4990-8d78-4b509b3f7a47 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Jun 07 21:56:44.864323 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 25/48] 10.222.0.13 () {56 vars in 1074 bytes} [Tue Jun 7 21:56:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 21:56:45.051774 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-d99c1888-f6ac-433a-b8a4-af2c3c8929d1 admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 21:56:45.057867 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.wsgi [None req-d99c1888-f6ac-433a-b8a4-af2c3c8929d1 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 07 21:56:45.059390 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-d99c1888-f6ac-433a-b8a4-af2c3c8929d1 admin admin] Request method failure captured: Jun 07 21:56:45.059390 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 07 21:56:45.059390 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: Accept: application/json Jun 07 21:56:45.059390 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: Accept-Encoding: gzip, deflate Jun 07 21:56:45.059390 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: Connection: keep-alive Jun 07 21:56:45.059390 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: Content-Length: 0 Jun 07 21:56:45.059390 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: Host: 10.222.0.13 Jun 07 21:56:45.059390 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: Openstack-Api-Version: compute 2.90 Jun 07 21:56:45.059390 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: Openstack-System-Scope: None Jun 07 21:56:45.059390 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: User-Agent: python-novaclient Jun 07 21:56:45.059390 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: X-Auth-Token: gAAAAABin8mcGhSc14JpaLxHhu-NcSPvV4oO0F5M6Urtf2ui-kCTyHeE9_wsZ5-V409vRezrQj-2m7csNBwKzRDHaRrMuoDPWJb1ApPmEkY8nXNxLgB45EGepbccthvClkRU95XOkOKL821762wNuKfL_oxmvVqf8STxeDLxbYB7Fvxd_xs0pMk Jun 07 21:56:45.059390 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: X-Domain-Id: None Jun 07 21:56:45.059390 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: X-Domain-Name: None Jun 07 21:56:45.059390 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: X-Identity-Status: Confirmed Jun 07 21:56:45.059390 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: X-Is-Admin-Project: True Jun 07 21:56:45.059390 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: X-Openstack-Nova-Api-Version: 2.90 Jun 07 21:56:45.059390 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: X-Project-Domain-Id: default Jun 07 21:56:45.059390 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: X-Project-Domain-Name: Default Jun 07 21:56:45.059390 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: X-Project-Id: c61211fad6e447b0bf162f99f1111a82 Jun 07 21:56:45.059390 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: X-Project-Name: admin Jun 07 21:56:45.059390 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: X-Role: admin,member,reader Jun 07 21:56:45.059390 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: X-Roles: admin,member,reader Jun 07 21:56:45.060723 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c61211fad6e447b0bf162f99f1111a82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c61211fad6e447b0bf162f99f1111a82"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c61211fad6e447b0bf162f99f1111a82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c61211fad6e447b0bf162f99f1111a82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}] Jun 07 21:56:45.060723 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: X-Tenant: admin Jun 07 21:56:45.060723 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: X-Tenant-Id: c61211fad6e447b0bf162f99f1111a82 Jun 07 21:56:45.060723 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: X-Tenant-Name: admin Jun 07 21:56:45.060723 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: X-User: admin Jun 07 21:56:45.060723 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: X-User-Domain-Id: default Jun 07 21:56:45.060723 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: X-User-Domain-Name: Default Jun 07 21:56:45.060723 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: X-User-Id: c9d023b1a9bd4c969261ea4adeb6b556 Jun 07 21:56:45.060723 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: X-User-Name: admin Jun 07 21:56:45.060723 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: method: > Jun 07 21:56:45.060723 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: exception: Flavor 451 could not be found. Jun 07 21:56:45.060723 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: action_args: {'id': '451'} Jun 07 21:56:45.060723 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 21:56:45.060723 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 21:56:45.061551 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 07 21:56:45.061551 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 07 21:56:45.061551 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 07 21:56:45.061551 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 07 21:56:45.061551 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 07 21:56:45.061551 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 07 21:56:45.061551 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 07 21:56:45.061551 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 07 21:56:45.061551 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 07 21:56:45.061551 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 21:56:45.061551 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 07 21:56:45.061551 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 07 21:56:45.061551 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 07 21:56:45.061551 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Jun 07 21:56:45.061551 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 21:56:45.061551 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Jun 07 21:56:45.061551 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 21:56:45.061551 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 21:56:45.061551 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 21:56:45.062614 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 21:56:45.062614 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 21:56:45.062614 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 21:56:45.062614 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 21:56:45.062614 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 07 21:56:45.062614 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 07 21:56:45.062614 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 07 21:56:45.062614 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Jun 07 21:56:45.062614 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 21:56:45.062614 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Jun 07 21:56:45.062614 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 21:56:45.062614 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 21:56:45.062614 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 21:56:45.062614 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 21:56:45.062614 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 21:56:45.062614 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 07 21:56:45.062614 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Jun 07 21:56:45.062614 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-d99c1888-f6ac-433a-b8a4-af2c3c8929d1 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 21:56:45.063652 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-d99c1888-f6ac-433a-b8a4-af2c3c8929d1 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.060509 Jun 07 21:56:45.063652 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 24/49] 10.222.0.13 () {60 vars in 1193 bytes} [Tue Jun 7 21:56:44 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 07 21:56:45.071355 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-3e3c78e6-9c87-4d21-a9fe-0cf51418f740 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 21:56:45.086277 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-3e3c78e6-9c87-4d21-a9fe-0cf51418f740 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019323 Jun 07 21:56:45.086809 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 26/50] 10.222.0.13 () {60 vars in 1210 bytes} [Tue Jun 7 21:56:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 21:56:45.096146 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-832a72e9-1ab8-41c1-acd5-0f2ec05a0abf admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 21:56:45.109854 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-832a72e9-1ab8-41c1-acd5-0f2ec05a0abf admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017261 Jun 07 21:56:45.110407 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 25/51] 10.222.0.13 () {60 vars in 1210 bytes} [Tue Jun 7 21:56:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 21:56:45.119540 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-efc0a409-2d70-4e3b-a2c7-9ad60f94a65b admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 21:56:45.124841 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.wsgi [None req-efc0a409-2d70-4e3b-a2c7-9ad60f94a65b admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 07 21:56:45.126329 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-efc0a409-2d70-4e3b-a2c7-9ad60f94a65b admin admin] Request method failure captured: Jun 07 21:56:45.126329 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 07 21:56:45.126329 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: Accept: application/json Jun 07 21:56:45.126329 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: Accept-Encoding: gzip, deflate Jun 07 21:56:45.126329 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: Connection: keep-alive Jun 07 21:56:45.126329 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: Content-Length: 0 Jun 07 21:56:45.126329 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: Host: 10.222.0.13 Jun 07 21:56:45.126329 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: Openstack-Api-Version: compute 2.90 Jun 07 21:56:45.126329 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: Openstack-System-Scope: None Jun 07 21:56:45.126329 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: User-Agent: python-novaclient Jun 07 21:56:45.126329 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: X-Auth-Token: gAAAAABin8mcGhSc14JpaLxHhu-NcSPvV4oO0F5M6Urtf2ui-kCTyHeE9_wsZ5-V409vRezrQj-2m7csNBwKzRDHaRrMuoDPWJb1ApPmEkY8nXNxLgB45EGepbccthvClkRU95XOkOKL821762wNuKfL_oxmvVqf8STxeDLxbYB7Fvxd_xs0pMk Jun 07 21:56:45.126329 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: X-Domain-Id: None Jun 07 21:56:45.126329 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: X-Domain-Name: None Jun 07 21:56:45.126329 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: X-Identity-Status: Confirmed Jun 07 21:56:45.126329 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: X-Is-Admin-Project: True Jun 07 21:56:45.126329 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: X-Openstack-Nova-Api-Version: 2.90 Jun 07 21:56:45.126329 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: X-Project-Domain-Id: default Jun 07 21:56:45.126329 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: X-Project-Domain-Name: Default Jun 07 21:56:45.126329 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: X-Project-Id: c61211fad6e447b0bf162f99f1111a82 Jun 07 21:56:45.126329 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: X-Project-Name: admin Jun 07 21:56:45.126329 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: X-Role: admin,member,reader Jun 07 21:56:45.126329 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: X-Roles: admin,member,reader Jun 07 21:56:45.127898 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c61211fad6e447b0bf162f99f1111a82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c61211fad6e447b0bf162f99f1111a82"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c61211fad6e447b0bf162f99f1111a82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c61211fad6e447b0bf162f99f1111a82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}] Jun 07 21:56:45.127898 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: X-Tenant: admin Jun 07 21:56:45.127898 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: X-Tenant-Id: c61211fad6e447b0bf162f99f1111a82 Jun 07 21:56:45.127898 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: X-Tenant-Name: admin Jun 07 21:56:45.127898 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: X-User: admin Jun 07 21:56:45.127898 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: X-User-Domain-Id: default Jun 07 21:56:45.127898 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: X-User-Domain-Name: Default Jun 07 21:56:45.127898 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: X-User-Id: c9d023b1a9bd4c969261ea4adeb6b556 Jun 07 21:56:45.127898 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: X-User-Name: admin Jun 07 21:56:45.127898 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: method: > Jun 07 21:56:45.127898 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: exception: Flavor 451 could not be found. Jun 07 21:56:45.127898 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: action_args: {'id': '451'} Jun 07 21:56:45.127898 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 21:56:45.127898 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 21:56:45.128816 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 07 21:56:45.128816 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 07 21:56:45.128816 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 07 21:56:45.128816 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 07 21:56:45.128816 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 07 21:56:45.128816 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 07 21:56:45.128816 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 07 21:56:45.128816 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 07 21:56:45.128816 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 07 21:56:45.128816 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 21:56:45.128816 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 07 21:56:45.128816 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 07 21:56:45.128816 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 07 21:56:45.128816 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Jun 07 21:56:45.128816 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 21:56:45.128816 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Jun 07 21:56:45.128816 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 21:56:45.128816 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 21:56:45.128816 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 21:56:45.130738 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 21:56:45.130738 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 21:56:45.130738 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 21:56:45.130738 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 21:56:45.130738 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 07 21:56:45.130738 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 07 21:56:45.130738 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 07 21:56:45.130738 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Jun 07 21:56:45.130738 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 21:56:45.130738 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Jun 07 21:56:45.130738 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 21:56:45.130738 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 21:56:45.130738 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 21:56:45.130738 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 21:56:45.130738 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 21:56:45.130738 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 07 21:56:45.130738 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Jun 07 21:56:45.130738 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-efc0a409-2d70-4e3b-a2c7-9ad60f94a65b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 21:56:45.132050 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-efc0a409-2d70-4e3b-a2c7-9ad60f94a65b admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011695 Jun 07 21:56:45.132050 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 27/52] 10.222.0.13 () {60 vars in 1193 bytes} [Tue Jun 7 21:56:45 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 07 21:56:46.003486 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-832a72e9-1ab8-41c1-acd5-0f2ec05a0abf admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 21:56:46.004493 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-832a72e9-1ab8-41c1-acd5-0f2ec05a0abf admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Jun 07 21:56:46.004885 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 26/53] 10.222.0.13 () {56 vars in 1074 bytes} [Tue Jun 7 21:56:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 21:56:46.192428 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-4f56b9f4-d730-41bd-bb1f-ed7704d385a3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 21:56:46.210456 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-4f56b9f4-d730-41bd-bb1f-ed7704d385a3 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.068779 Jun 07 21:56:46.211021 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 28/54] 10.222.0.13 () {64 vars in 1235 bytes} [Tue Jun 7 21:56:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 21:56:47.073186 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-832a72e9-1ab8-41c1-acd5-0f2ec05a0abf admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 21:56:47.074192 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-832a72e9-1ab8-41c1-acd5-0f2ec05a0abf admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Jun 07 21:56:47.074589 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 27/55] 10.222.0.13 () {56 vars in 1074 bytes} [Tue Jun 7 21:56:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 21:56:47.260959 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-bb7149b4-34b7-4fd4-95e7-2ab3aae4d063 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 21:56:47.278428 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-bb7149b4-34b7-4fd4-95e7-2ab3aae4d063 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.068585 Jun 07 21:56:47.278977 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 29/56] 10.222.0.13 () {64 vars in 1235 bytes} [Tue Jun 7 21:56:47 2022] POST /compute/v2.1/flavors => generated 405 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 21:56:48.148684 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-832a72e9-1ab8-41c1-acd5-0f2ec05a0abf admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 21:56:48.149707 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-832a72e9-1ab8-41c1-acd5-0f2ec05a0abf admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Jun 07 21:56:48.150095 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 28/57] 10.222.0.13 () {56 vars in 1074 bytes} [Tue Jun 7 21:56:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 21:56:48.356370 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-69b63491-a5b6-44b2-8a7f-b1ab57ba5aa6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 21:56:48.373526 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-69b63491-a5b6-44b2-8a7f-b1ab57ba5aa6 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.072474 Jun 07 21:56:48.374009 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 30/58] 10.222.0.13 () {64 vars in 1235 bytes} [Tue Jun 7 21:56:48 2022] POST /compute/v2.1/flavors => generated 407 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 21:56:49.251221 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-832a72e9-1ab8-41c1-acd5-0f2ec05a0abf admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 21:56:49.252248 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-832a72e9-1ab8-41c1-acd5-0f2ec05a0abf admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Jun 07 21:56:49.252642 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 29/59] 10.222.0.13 () {56 vars in 1074 bytes} [Tue Jun 7 21:56:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 21:56:49.439591 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-6289d76d-69d4-4cf1-85b7-9f069cf1a9c8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 21:56:49.457324 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-6289d76d-69d4-4cf1-85b7-9f069cf1a9c8 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.068368 Jun 07 21:56:49.457860 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 31/60] 10.222.0.13 () {64 vars in 1235 bytes} [Tue Jun 7 21:56:49 2022] POST /compute/v2.1/flavors => generated 409 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 21:56:50.456507 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-832a72e9-1ab8-41c1-acd5-0f2ec05a0abf admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 21:56:50.457505 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-832a72e9-1ab8-41c1-acd5-0f2ec05a0abf admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Jun 07 21:56:50.458598 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 30/61] 10.222.0.13 () {56 vars in 1074 bytes} [Tue Jun 7 21:56:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 21:56:50.683599 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-c5bb3d71-db4c-404e-a491-347111208905 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 21:56:50.702935 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-c5bb3d71-db4c-404e-a491-347111208905 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.070771 Jun 07 21:56:50.703503 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 32/62] 10.222.0.13 () {60 vars in 1202 bytes} [Tue Jun 7 21:56:50 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 21:57:52.339909 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-832a72e9-1ab8-41c1-acd5-0f2ec05a0abf admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 21:57:52.340949 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-832a72e9-1ab8-41c1-acd5-0f2ec05a0abf admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Jun 07 21:57:52.341348 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 31/63] 10.222.0.13 () {54 vars in 930 bytes} [Tue Jun 7 21:57:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 21:57:52.352451 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG dbcounter [-] [103360] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:57:52.399924 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-0c2d4582-0f16-49a1-a808-624bc21654e3 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 21:57:52.418932 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-0c2d4582-0f16-49a1-a808-624bc21654e3 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.071873 Jun 07 21:57:52.419486 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 33/64] 10.222.0.13 () {60 vars in 1291 bytes} [Tue Jun 7 21:57:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 21:57:52.440311 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG dbcounter [-] [103361] Writing DB stats nova_api:SELECT=14 {{(pid=103361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:57:52.444871 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-f8cca774-c9eb-4f60-9ead-6feabceab6e1 admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 21:57:52.452550 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-f8cca774-c9eb-4f60-9ead-6feabceab6e1 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013677 Jun 07 21:57:52.453078 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 32/65] 10.222.0.13 () {60 vars in 1282 bytes} [Tue Jun 7 21:57:52 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 21:57:52.464182 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-e16a77e1-a4eb-4c5a-b21d-a79dc65f50b5 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 21:57:52.472011 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-e16a77e1-a4eb-4c5a-b21d-a79dc65f50b5 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011278 Jun 07 21:57:52.472542 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 34/66] 10.222.0.13 () {60 vars in 1285 bytes} [Tue Jun 7 21:57:52 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 21:57:52.483757 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-014693e4-96bf-464d-a25c-ed98aeaf74dd admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 21:57:52.491798 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-014693e4-96bf-464d-a25c-ed98aeaf74dd admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011450 Jun 07 21:57:52.492313 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 33/67] 10.222.0.13 () {60 vars in 1285 bytes} [Tue Jun 7 21:57:52 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 21:57:52.505431 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-456fec26-caf8-4a7e-9a79-c1d1a39e385c admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 21:57:52.514563 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-456fec26-caf8-4a7e-9a79-c1d1a39e385c admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014575 Jun 07 21:57:52.515430 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 35/68] 10.222.0.13 () {60 vars in 1282 bytes} [Tue Jun 7 21:57:52 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:01:01.621445 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-014693e4-96bf-464d-a25c-ed98aeaf74dd admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:01:01.622453 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-014693e4-96bf-464d-a25c-ed98aeaf74dd admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Jun 07 22:01:01.622848 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 34/69] 10.222.0.13 () {56 vars in 1074 bytes} [Tue Jun 7 22:01:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:01:01.780411 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG dbcounter [-] [103360] Writing DB stats nova_api:SELECT=6 {{(pid=103360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:01:01.896777 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-72873328-9e62-4aa3-b133-8b99e388c429 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:01:01.897946 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 22:01:01.897946 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: warnings.warn(msg) Jun 07 22:01:01.899145 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG oslo_concurrency.lockutils [None req-72873328-9e62-4aa3-b133-8b99e388c429 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:01:01.899621 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG oslo_concurrency.lockutils [None req-72873328-9e62-4aa3-b133-8b99e388c429 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:01:01.900437 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG oslo_concurrency.lockutils [None req-72873328-9e62-4aa3-b133-8b99e388c429 admin admin] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:01:01.900887 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG oslo_concurrency.lockutils [None req-72873328-9e62-4aa3-b133-8b99e388c429 admin admin] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:01:01.935109 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-72873328-9e62-4aa3-b133-8b99e388c429 admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.156243 Jun 07 22:01:01.935703 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 36/70] 10.222.0.13 () {60 vars in 1193 bytes} [Tue Jun 7 22:01:01 2022] GET /compute/v2.1/os-services => generated 791 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 22:01:02.806488 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-014693e4-96bf-464d-a25c-ed98aeaf74dd admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:01:02.807550 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-014693e4-96bf-464d-a25c-ed98aeaf74dd admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Jun 07 22:01:02.807952 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 35/71] 10.222.0.13 () {56 vars in 1074 bytes} [Tue Jun 7 22:01:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:01:02.998962 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-aa273e3f-5908-4f49-a42d-71257d98a4f0 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:01:03.000702 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 22:01:03.000702 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: warnings.warn(msg) Jun 07 22:01:03.001908 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG oslo_concurrency.lockutils [None req-aa273e3f-5908-4f49-a42d-71257d98a4f0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:01:03.002365 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG oslo_concurrency.lockutils [None req-aa273e3f-5908-4f49-a42d-71257d98a4f0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:01:03.003137 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG oslo_concurrency.lockutils [None req-aa273e3f-5908-4f49-a42d-71257d98a4f0 admin admin] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:01:03.003583 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG oslo_concurrency.lockutils [None req-aa273e3f-5908-4f49-a42d-71257d98a4f0 admin admin] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:01:03.028598 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-aa273e3f-5908-4f49-a42d-71257d98a4f0 admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.081443 Jun 07 22:01:03.029086 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 37/72] 10.222.0.13 () {60 vars in 1193 bytes} [Tue Jun 7 22:01:02 2022] GET /compute/v2.1/os-services => generated 791 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 22:01:14.342171 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-014693e4-96bf-464d-a25c-ed98aeaf74dd admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:01:14.343177 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-014693e4-96bf-464d-a25c-ed98aeaf74dd admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Jun 07 22:01:14.344238 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 36/73] 10.222.0.13 () {56 vars in 1074 bytes} [Tue Jun 7 22:01:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:01:14.485871 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG dbcounter [-] [103360] Writing DB stats nova_cell0:SELECT=4 {{(pid=103360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:01:14.486585 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG dbcounter [-] [103360] Writing DB stats nova_cell1:SELECT=4 {{(pid=103360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:01:14.487208 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG dbcounter [-] [103360] Writing DB stats nova_api:SELECT=8 {{(pid=103360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:01:14.535215 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-6af97486-dbd3-44cb-b333-ea4134a9ac12 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:01:14.536425 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 22:01:14.536425 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: warnings.warn(msg) Jun 07 22:01:14.538457 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG oslo_concurrency.lockutils [None req-6af97486-dbd3-44cb-b333-ea4134a9ac12 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:01:14.539208 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG oslo_concurrency.lockutils [None req-6af97486-dbd3-44cb-b333-ea4134a9ac12 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:01:14.540546 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG oslo_concurrency.lockutils [None req-6af97486-dbd3-44cb-b333-ea4134a9ac12 admin admin] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:01:14.541180 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG oslo_concurrency.lockutils [None req-6af97486-dbd3-44cb-b333-ea4134a9ac12 admin admin] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:01:14.566464 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-6af97486-dbd3-44cb-b333-ea4134a9ac12 admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.084971 Jun 07 22:01:14.566940 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 38/74] 10.222.0.13 () {60 vars in 1193 bytes} [Tue Jun 7 22:01:14 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:01:15.446968 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-014693e4-96bf-464d-a25c-ed98aeaf74dd admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:01:15.448006 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-014693e4-96bf-464d-a25c-ed98aeaf74dd admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Jun 07 22:01:15.448406 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 37/75] 10.222.0.13 () {56 vars in 1074 bytes} [Tue Jun 7 22:01:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:01:15.635858 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-710bcd9d-28fa-49c8-a754-8898556bf415 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:01:15.637007 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 22:01:15.637007 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: warnings.warn(msg) Jun 07 22:01:15.638187 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG oslo_concurrency.lockutils [None req-710bcd9d-28fa-49c8-a754-8898556bf415 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:01:15.638691 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG oslo_concurrency.lockutils [None req-710bcd9d-28fa-49c8-a754-8898556bf415 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:01:15.639485 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG oslo_concurrency.lockutils [None req-710bcd9d-28fa-49c8-a754-8898556bf415 admin admin] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:01:15.639902 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: DEBUG oslo_concurrency.lockutils [None req-710bcd9d-28fa-49c8-a754-8898556bf415 admin admin] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:01:15.664257 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-710bcd9d-28fa-49c8-a754-8898556bf415 admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.079473 Jun 07 22:01:15.664721 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 39/76] 10.222.0.13 () {60 vars in 1193 bytes} [Tue Jun 7 22:01:15 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:02:13.130406 dv-cinder-835525-4-iscsi devstack@n-api.service[103359]: Tue Jun 7 22:02:13 2022 - graceful shutdown triggered... Jun 07 22:02:13.130540 dv-cinder-835525-4-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 07 22:02:13.131546 dv-cinder-835525-4-iscsi devstack@n-api.service[103360]: Gracefully killing worker 1 (pid: 103360)... Jun 07 22:02:13.131982 dv-cinder-835525-4-iscsi devstack@n-api.service[103361]: Gracefully killing worker 2 (pid: 103361)... Jun 07 22:02:14.132624 dv-cinder-835525-4-iscsi devstack@n-api.service[103359]: worker 1 buried after 1 seconds Jun 07 22:02:14.132624 dv-cinder-835525-4-iscsi devstack@n-api.service[103359]: worker 2 buried after 1 seconds Jun 07 22:02:14.132624 dv-cinder-835525-4-iscsi devstack@n-api.service[103359]: goodbye to uWSGI. Jun 07 22:02:14.134173 dv-cinder-835525-4-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 07 22:02:14.134762 dv-cinder-835525-4-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 07 22:02:14.137455 dv-cinder-835525-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 07 22:02:14.152489 dv-cinder-835525-4-iscsi devstack@n-api.service[117954]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 07 22:02:14.184202 dv-cinder-835525-4-iscsi devstack@n-api.service[117954]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jun 7 22:02:14 2022] *** Jun 07 22:02:14.184202 dv-cinder-835525-4-iscsi devstack@n-api.service[117954]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 07 22:02:14.184202 dv-cinder-835525-4-iscsi devstack@n-api.service[117954]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 07 22:02:14.184202 dv-cinder-835525-4-iscsi devstack@n-api.service[117954]: nodename: dv-cinder-835525-4-iscsi Jun 07 22:02:14.184202 dv-cinder-835525-4-iscsi devstack@n-api.service[117954]: machine: x86_64 Jun 07 22:02:14.184202 dv-cinder-835525-4-iscsi devstack@n-api.service[117954]: clock source: unix Jun 07 22:02:14.184202 dv-cinder-835525-4-iscsi devstack@n-api.service[117954]: pcre jit disabled Jun 07 22:02:14.184202 dv-cinder-835525-4-iscsi devstack@n-api.service[117954]: detected number of CPU cores: 4 Jun 07 22:02:14.184202 dv-cinder-835525-4-iscsi devstack@n-api.service[117954]: current working directory: / Jun 07 22:02:14.184202 dv-cinder-835525-4-iscsi devstack@n-api.service[117954]: detected binary path: /usr/bin/uwsgi-core Jun 07 22:02:14.184202 dv-cinder-835525-4-iscsi devstack@n-api.service[117954]: your processes number limit is 47680 Jun 07 22:02:14.184202 dv-cinder-835525-4-iscsi devstack@n-api.service[117954]: your memory page size is 4096 bytes Jun 07 22:02:14.184202 dv-cinder-835525-4-iscsi devstack@n-api.service[117954]: detected max file descriptor number: 2048 Jun 07 22:02:14.184202 dv-cinder-835525-4-iscsi devstack@n-api.service[117954]: lock engine: pthread robust mutexes Jun 07 22:02:14.185560 dv-cinder-835525-4-iscsi devstack@n-api.service[117954]: thunder lock: enabled Jun 07 22:02:14.185560 dv-cinder-835525-4-iscsi devstack@n-api.service[117954]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 07 22:02:14.185560 dv-cinder-835525-4-iscsi devstack@n-api.service[117954]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 07 22:02:14.230013 dv-cinder-835525-4-iscsi devstack@n-api.service[117954]: Python main interpreter initialized at 0x55c63cc819c0 Jun 07 22:02:14.230013 dv-cinder-835525-4-iscsi devstack@n-api.service[117954]: python threads support enabled Jun 07 22:02:14.230013 dv-cinder-835525-4-iscsi devstack@n-api.service[117954]: your server socket listen backlog is limited to 100 connections Jun 07 22:02:14.230013 dv-cinder-835525-4-iscsi devstack@n-api.service[117954]: your mercy for graceful operations on workers is 90 seconds Jun 07 22:02:14.230406 dv-cinder-835525-4-iscsi devstack@n-api.service[117954]: mapped 403077 bytes (393 KB) for 2 cores Jun 07 22:02:14.230406 dv-cinder-835525-4-iscsi devstack@n-api.service[117954]: *** Operational MODE: preforking *** Jun 07 22:02:14.230679 dv-cinder-835525-4-iscsi devstack@n-api.service[117954]: *** uWSGI is running in multiple interpreter mode *** Jun 07 22:02:14.230679 dv-cinder-835525-4-iscsi devstack@n-api.service[117954]: spawned uWSGI master process (pid: 117954) Jun 07 22:02:14.230896 dv-cinder-835525-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 07 22:02:14.231503 dv-cinder-835525-4-iscsi devstack@n-api.service[117954]: spawned uWSGI worker 1 (pid: 117970, cores: 1) Jun 07 22:02:14.231826 dv-cinder-835525-4-iscsi devstack@n-api.service[117954]: spawned uWSGI worker 2 (pid: 117971, cores: 1) Jun 07 22:02:14.232045 dv-cinder-835525-4-iscsi devstack@n-api.service[117954]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 07 22:02:15.468705 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 07 22:02:15.501379 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 07 22:02:16.298206 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 22:02:16.298206 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: from cryptography.utils import int_from_bytes Jun 07 22:02:16.298529 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 22:02:16.298529 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: from cryptography.utils import int_from_bytes Jun 07 22:02:16.351394 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 22:02:16.351394 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: from cryptography.utils import int_from_bytes Jun 07 22:02:16.351833 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 22:02:16.351833 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: from cryptography.utils import int_from_bytes Jun 07 22:02:18.704387 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 07 22:02:18.704982 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 07 22:02:18.705165 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 07 22:02:18.705529 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 07 22:02:18.705782 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 07 22:02:18.706166 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.706488 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.706807 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.707121 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.707520 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.707847 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.708173 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.708495 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.708822 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.709081 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.709393 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.709714 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835525-4-iscsi {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.711171 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.711171 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.711171 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.711171 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.711707 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.711707 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.711847 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.712337 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.713791 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.713791 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.713791 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.713791 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.714098 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.714267 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.714585 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.714890 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.715198 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.715535 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.715954 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835525-4-iscsi {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.716283 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.716606 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.716914 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.717482 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.717806 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.718113 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.718438 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.718735 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.719035 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.719385 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.719699 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.720008 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.720318 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.720617 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.720920 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.721223 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.721539 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.721843 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.722149 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.722386 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.722692 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.723007 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.723345 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.723662 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.723910 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.724156 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.724507 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.724784 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.725089 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.725648 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.725956 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.726263 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.726566 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.726870 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.727173 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.727502 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.727819 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.728140 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.728455 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.728761 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.729076 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.729468 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.729717 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.730021 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.730358 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.730672 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.730978 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.731293 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.731638 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.732530 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.733086 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.733488 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.733809 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.734144 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.734448 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.734697 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.734998 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.735302 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.735642 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.735947 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.736251 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.736555 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.736854 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.737161 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.737464 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.737767 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.738071 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.738397 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.738678 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.738980 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.739283 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.739612 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.739929 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.740247 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.740552 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.740853 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.741153 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.741455 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.741774 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.742074 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.742375 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.742689 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.742990 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.743291 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.743627 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.743933 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.744235 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.744549 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.744845 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.745146 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.745459 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.745759 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.746064 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.746366 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.746667 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.746974 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.747277 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.748241 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.748548 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.748853 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.749164 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.749675 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.749790 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.750076 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.750377 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.750693 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.751032 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.751376 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.751720 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.752033 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.752361 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.752691 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.753010 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.757332 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.757332 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.757332 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.757332 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.757332 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.757332 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.757332 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.757332 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.758204 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.758204 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.758204 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.758204 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.758204 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.758204 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.758204 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.758204 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.759093 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.759093 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.759093 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.760059 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.760059 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.760059 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.760606 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.760606 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.761819 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.761819 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.761819 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.761819 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.762616 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.762616 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.763071 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.763071 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.763597 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.768939 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.768939 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.768939 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.768939 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.768939 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.768939 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.768939 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.768939 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.770140 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.770140 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.770140 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.770140 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.770140 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.770140 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.770140 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.770140 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.771462 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.771462 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.771462 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.771462 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.771462 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.771462 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.771462 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.772489 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.772489 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.772489 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.772907 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.772907 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.773196 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.773439 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.773742 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.774049 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.774361 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.774670 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.774977 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.775284 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.775617 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.775937 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.776248 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.776557 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.776887 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.777216 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.777519 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.777932 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.778258 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.778571 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.778982 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.779286 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.779618 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.780119 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.780449 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.780842 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.781185 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.781514 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.781820 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.782126 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.782432 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.782743 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.783047 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.783425 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.783729 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.784033 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.784473 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.784742 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.784993 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.785330 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.785645 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.785957 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.786266 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.786579 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.787111 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.787825 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.788295 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.788613 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.788936 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.789249 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.789569 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.789882 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.790471 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.790845 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.791178 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.791497 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.791818 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.792159 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.792666 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.793250 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.793858 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.794966 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.795416 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.795749 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.796063 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.796379 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.796694 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.797018 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.797333 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.797654 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.797968 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.798303 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.798873 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.799526 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.800036 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.800502 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.800839 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.801173 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.801485 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.801810 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.802120 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.802438 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.802747 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.803056 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.803384 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.803690 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.804002 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.804318 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.804631 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.804966 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.805240 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.805557 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.805870 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.806176 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.806484 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.806656 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 07 22:02:18.807159 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 07 22:02:18.807311 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.807311 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.807687 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 07 22:02:18.807871 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.808057 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 07 22:02:18.808223 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.808383 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 07 22:02:18.808563 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.808904 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.809138 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.809373 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.809612 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.809612 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.810539 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.810710 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.810874 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.811077 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.811269 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.811480 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.811635 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.811814 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.811998 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.812181 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.812412 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.812623 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.812844 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.813062 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.813300 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.813542 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.813755 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.813978 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.814200 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835525-4-iscsi {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.814427 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.814646 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.814896 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.815241 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.815523 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.815742 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.815978 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.816180 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.816335 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.816510 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.816661 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.816817 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.816983 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.817134 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.817283 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.817283 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.817568 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.817744 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.817914 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.818081 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.818249 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.818408 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.818565 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.818799 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.819089 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.819253 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.819439 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.819602 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.819753 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.819913 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.820065 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.820215 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.820376 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.820612 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.820787 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.820787 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.821090 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.821239 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835525-4-iscsi {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.821396 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.821555 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.821718 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.821876 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.822026 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.822175 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.822332 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.822332 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.822639 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.822791 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.822939 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.823095 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.823253 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.823441 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.823602 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.823766 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.823917 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.824082 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.824235 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.824394 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.824556 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.824720 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.824883 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.825036 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.825210 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.825439 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.825661 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.825815 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.825980 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.826133 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.826283 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.826441 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.826441 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.826748 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.826914 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.827066 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.827260 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.827473 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.827626 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.827775 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.827775 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.828079 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.828245 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.828397 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.828397 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.828704 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.828864 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.829021 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.829278 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.829444 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.829599 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.829758 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.829920 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.830070 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.830222 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.830379 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.830540 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.830702 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.830854 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.831003 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.831163 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.831313 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.831518 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.831679 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.831679 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.831974 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.832130 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.832280 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.832439 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.832610 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.832760 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.832916 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.833066 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.833223 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.833396 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.833556 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.833556 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.833843 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.834001 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.834165 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.834330 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.834488 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.834662 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.834825 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.834976 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.835135 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.835286 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.835568 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.835735 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.835886 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.836036 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.836199 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.836350 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.836499 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.836647 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.836808 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.836958 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.837122 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.837272 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.837428 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.837589 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.837739 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.837898 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.838049 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.838204 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.838363 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.838520 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.838681 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.838845 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.838997 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.839153 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.839348 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.839589 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.839757 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.839922 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.840074 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.840223 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.840381 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.840538 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.840689 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.840862 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.841023 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.841204 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.841364 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.841515 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.841673 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.841824 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.841973 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.842131 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.842288 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.842446 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.842605 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.842763 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.842935 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.843088 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.843273 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.843453 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.843622 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.843781 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.843947 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.844099 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.844264 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.844414 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.844573 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.844743 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.844743 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.845040 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.845191 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.845350 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.845509 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.845757 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.845757 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.846048 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.846199 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.846361 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.846520 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.846679 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.846911 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.847065 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.847240 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.847432 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.847598 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.847757 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.847757 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.848060 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.848211 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.848361 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.848510 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.848660 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.848819 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.848977 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.849154 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.849315 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.849467 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.849641 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.849892 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.850057 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.850215 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.850628 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.850783 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.850941 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.851100 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.851251 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.851477 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.851583 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.851673 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.851772 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.851885 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.851972 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.852063 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.852148 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.852239 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.852337 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.852429 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.852539 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.852625 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.852708 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.852790 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.852882 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.852991 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.853062 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.853144 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.853237 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.853334 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.853418 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.853518 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.853603 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.853685 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.853766 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.853860 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.853945 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.854026 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.854115 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.854198 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.854287 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 22:02:18.854379 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.854464 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.854546 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.854627 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.854709 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.854791 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.854880 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.854965 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.855047 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.855047 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.855206 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.855303 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.855419 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.855505 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.855587 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.855669 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.855750 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.855851 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.855954 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.856042 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.856133 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.856217 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.856307 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.856419 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.856513 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.856597 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.857269 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.857379 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.858015 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.858132 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.858228 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.858313 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.858396 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.858498 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.858608 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.858694 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.858777 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.858777 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.858936 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.859027 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.859124 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.859215 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.859427 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.859427 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.859584 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.859654 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.859757 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.859843 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.859927 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.860054 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.860155 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.860248 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.860341 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.860511 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.860698 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.860866 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.861034 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.861197 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.861368 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.861529 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.861680 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.861838 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.861998 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.862157 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.862317 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.862468 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.862625 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.862777 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.862927 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.863116 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.863279 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.863495 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.863650 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.863807 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.863967 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.864131 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.864282 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.864440 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.864599 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.864756 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.864938 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.865107 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.865258 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.865408 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.865569 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.865721 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.865902 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.866161 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.866327 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.866488 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.866648 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.866806 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.866966 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.867124 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.867276 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.867490 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.867653 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.867854 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.868008 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.868167 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.868328 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.868478 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.868668 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.868834 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.868994 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.868994 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.869339 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.869507 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.869700 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.869877 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.870056 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.870298 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.870464 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.870616 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.870773 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.870933 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.871085 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.871242 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.871437 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.871562 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.871667 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.871757 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.871852 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.871939 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.872030 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.872121 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.872214 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.872409 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.873042 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.873694 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.873806 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.873902 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.874001 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.874001 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.874165 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.874249 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.874338 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.874422 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.874514 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.874597 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.874687 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.874771 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.874853 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.875027 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.875115 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.875251 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.875372 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.875602 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.875714 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.875927 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.876027 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.876439 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.876532 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.876605 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.876723 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.877009 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.877217 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.877217 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.877425 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.877568 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.877780 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.877959 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.878145 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.878310 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.878473 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.878627 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.878794 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.878946 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.879098 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.879256 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.879448 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.879601 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.879767 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.879932 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.880084 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.880242 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.880516 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.880675 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.880838 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.881004 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.881160 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.881318 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.881469 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.881620 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.881778 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.881939 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.882108 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.882260 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.882409 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.882642 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.882803 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.882955 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.883106 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.883256 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.883520 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.883692 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.883846 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.884005 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.884168 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.884327 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.884480 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.884639 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.884790 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.884940 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.885091 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.885248 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.885399 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.885564 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.885716 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.885865 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.886014 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.886190 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.886445 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.886613 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.886766 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.886916 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.887065 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.887216 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.887418 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.887586 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.887751 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.887912 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.888094 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.888256 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.888435 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.888594 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.888745 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.888902 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.888902 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.889206 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.889370 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.889522 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.889671 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.889820 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.889977 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.890140 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.890300 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.890462 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.890718 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.890882 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.891048 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.891213 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.891385 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.891593 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.891750 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.891901 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.892060 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.892223 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.892376 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.892543 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.892742 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.892742 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.893038 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.893198 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.893350 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.893533 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.893722 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.893884 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.894043 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.894195 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.894345 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.894496 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.894656 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.894842 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.895006 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.895159 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.895317 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.895515 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.895675 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.895834 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.895994 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.896153 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.896303 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.896477 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.896712 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.896923 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.897088 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.897240 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.897390 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.897540 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.897691 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.897847 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.898006 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.898157 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.898306 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.898455 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.898455 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.898764 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.898970 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.899128 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.899128 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.899455 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.899621 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.899796 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.899979 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.900150 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.900335 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.900517 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.900714 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.901383 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.901499 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.901631 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.901709 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.901779 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.901849 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.901933 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.902013 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.902104 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.902196 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.902296 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.902395 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.902487 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.902578 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.902662 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.902745 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.902835 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.902928 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.903075 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.903162 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.903245 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.903358 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.903434 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.903521 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.904241 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.904570 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.904980 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.905078 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.905174 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.905265 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.905433 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.905529 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.905613 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.905696 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.905805 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.905904 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.905984 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.906068 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.906151 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.906313 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.906528 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.906755 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.907033 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.907230 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.907455 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.907661 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.907858 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.907858 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.908886 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.909077 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.909277 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.909481 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.909655 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.909842 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.910015 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.910169 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.910327 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.910487 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.910694 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.910890 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.911080 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.911256 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.911485 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.911700 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.911980 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.912145 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.912352 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.912566 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.912764 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.912764 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.913099 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.913288 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.913475 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.913670 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.913980 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.914173 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.914379 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.914562 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.914743 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.914913 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.915136 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.915360 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.915568 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.915796 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.915987 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.916210 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.916387 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.916387 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.916730 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.916938 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.917210 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.917417 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.917616 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.917838 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.918005 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.918191 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.918383 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.918571 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.918767 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.918936 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.918936 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.919297 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.919559 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.919763 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.919763 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.920062 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.920223 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.920373 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.920537 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.920766 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.920934 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.921096 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.921247 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.921405 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.921581 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.921743 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.921743 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.922144 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.922311 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.922472 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.922631 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.922790 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.922948 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.923108 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.923268 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.923447 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.923617 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.923794 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.923957 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.924118 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.924278 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.924435 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.924594 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.924745 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.924909 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.925060 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.925209 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.925374 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.925533 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.925703 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.925864 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.926035 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.926195 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.926354 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.926513 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.926674 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.926833 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.926993 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.927168 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.927418 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.927605 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.927773 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.927925 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.928095 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.928247 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.928406 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.928565 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.928727 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.928879 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.929039 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.929191 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.929349 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.929510 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.929669 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.929827 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.929989 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.930141 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.930299 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.930459 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.930618 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.930780 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.930931 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.931089 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.931249 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.931435 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.931599 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.931759 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.931918 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.932080 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.932342 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.932502 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.932661 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.932819 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.932970 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.933128 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.933288 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.933446 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.933608 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.933768 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.933919 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.934069 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.934238 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.934391 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.934540 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.934690 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.935470 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.935470 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.935821 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.935974 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.936134 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.936285 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.936436 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.936681 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.936851 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.937015 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.937165 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.937323 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.937567 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.937734 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.937894 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.938046 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.938203 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.938354 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.938514 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.938679 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.938831 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.938993 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.939145 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.939338 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.939500 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.939672 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.939826 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.940010 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.940175 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.940335 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.940497 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.940650 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.940650 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.940936 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.941131 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.941288 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.941482 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.941638 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.941790 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.941940 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.942090 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.942251 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.942524 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.942692 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.942853 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.943012 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.943186 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.943374 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.943550 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.943704 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.943863 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.944018 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.944189 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.944355 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.944508 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.944666 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.944826 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.944985 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.945136 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.945311 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.945463 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.945612 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.945763 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.945914 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.946064 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.946227 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.946378 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.946529 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.946678 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.946835 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.947003 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.947155 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.947342 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.947502 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.947759 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.947759 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.948079 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.948232 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.948382 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.948541 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.948705 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.948864 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.949026 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.949177 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.949345 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.949504 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.949663 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.949822 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.949987 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.950140 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.950299 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.950486 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.950674 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.950841 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.951078 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.951305 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.951596 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.951860 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.952111 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.952371 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.952764 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.953047 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.953301 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.953525 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.953686 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.953866 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.954029 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.954197 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.954351 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.954513 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.954676 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.954841 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.954993 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.955144 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.955297 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.955479 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.955652 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.955812 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.955964 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.956123 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.956282 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.956435 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.956610 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.956770 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.956929 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.957081 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.957232 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.957383 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.957546 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.957699 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.957881 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.958040 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.958191 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.958349 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.958512 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.958512 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.958826 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.958985 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.959136 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.959295 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.959528 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.959683 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.959835 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.959985 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.960136 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.960300 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.960461 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.960621 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.960782 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.960933 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.961083 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.961243 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.961243 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.961532 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.961683 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.961834 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.961834 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.962128 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.962128 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.962424 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.962587 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.962766 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.963058 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.963220 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.963395 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.963593 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.963758 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.963918 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.964115 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.964269 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.964427 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.964578 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.964728 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.964898 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.965068 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.965227 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.965379 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.965530 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.965681 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.965846 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.965998 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.966671 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.966842 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.966995 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.967145 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.967305 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.967561 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.967751 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.967907 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.968059 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.968209 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.968444 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.968598 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.968759 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.968928 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.968928 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.969286 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.969509 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.969762 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.969927 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.970081 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.970238 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.970399 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.970602 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.970923 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.971085 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.971237 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.971237 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.971653 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.971653 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.971959 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.972126 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.972126 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.972414 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.972580 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.972580 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.972869 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.973047 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.973047 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.973454 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.973620 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.973785 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.973941 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.974103 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.974256 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.974416 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.974567 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.974718 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.974876 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.975038 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.975191 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.975661 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.975850 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.976095 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.976323 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.976323 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.976636 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.976798 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.976960 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.977121 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.977274 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.977431 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 07 22:02:18.977592 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.977592 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.977592 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.977592 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.977592 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.977592 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.977592 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.977592 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.978751 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.978751 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.978751 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.978751 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.978751 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.978751 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.978751 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.978751 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.979918 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.979918 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.979918 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.979918 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.979918 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.980658 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.980658 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.980658 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.981087 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.981235 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.981483 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.981872 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.982305 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.982883 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.983492 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.984092 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.984681 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.985241 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.985844 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.986411 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.986783 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.987154 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.987544 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.987901 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.988225 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.988622 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.988948 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.989308 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.989630 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.989987 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.990404 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.990776 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.991422 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.991780 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.992161 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.992515 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.992911 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.993393 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.993718 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.994040 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.994366 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.994685 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.995003 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.995332 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.995662 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.995977 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.996291 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.996607 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.996938 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.997251 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.998301 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.998582 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.998918 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.999199 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.999536 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:18.999888 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.000225 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.000682 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.001014 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.001353 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.001690 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.002010 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.002344 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.002726 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.002988 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.003311 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.003656 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.004021 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.004346 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.004708 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.005053 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.005374 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.005698 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.006022 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.006596 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.006931 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.007253 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.007598 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.007918 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.008237 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.008670 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.009021 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.009362 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.009686 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.010034 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.010389 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.010738 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.011095 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.011461 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.011827 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.012178 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.012530 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.012853 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.013852 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.014202 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.014537 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.014858 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.015182 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.015527 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.015847 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.016163 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.016481 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.016798 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.017115 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.017430 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.017748 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.018067 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.018433 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.018721 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.019168 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.019401 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.019689 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.020013 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.020543 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.020866 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.021202 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.021531 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.021861 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.022188 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.022514 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.022849 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.023161 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.023495 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.023814 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.024130 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.024441 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.024769 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.025086 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.025397 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.025722 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.026036 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.026600 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.026963 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.027304 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.027647 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.027982 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.028327 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.028679 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.029296 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.029564 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.029881 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.030212 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.030578 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.030851 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.031164 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.031509 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.031831 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.032143 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.032461 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.032772 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.033129 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.033466 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.033820 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.034149 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.034471 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.034777 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.035086 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.035418 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.035732 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.036050 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.036360 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.036673 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.036984 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.037301 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.037610 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.037923 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.038285 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.038613 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.038925 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.039239 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.039837 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.040220 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.040561 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.040887 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.041208 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.041567 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.041892 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.042455 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.042811 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.043169 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.043559 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.043924 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.044281 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.044613 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.044913 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.045245 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.045566 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.045882 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.046199 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.046517 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.046835 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.047150 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.047491 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.047809 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.048125 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.048441 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.048756 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.049101 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.049383 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.049704 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.050053 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.050377 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.050712 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.051014 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.051367 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.051553 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO dbcounter [None req-ade91ea5-884b-49cb-99f0-3396f8ec3607 None None] Registered counter for database nova_api Jun 07 22:02:19.051711 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.051980 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.052305 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.053724 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.053724 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.053724 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.053724 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.054355 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.054355 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.054653 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.054982 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.055306 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.055761 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.055967 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.056297 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.056615 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.056943 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.057260 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.057592 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.057939 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.058271 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.058601 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.058985 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.059217 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.059552 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.060438 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.060712 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.061031 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.061344 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.061646 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.062154 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.062336 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.062557 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.063001 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.063317 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.063660 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.064170 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.064368 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.064670 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.065091 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.065290 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.065601 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.065915 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.066223 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.066531 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.066840 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.067150 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.067481 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.067825 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.068164 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.068484 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.068811 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.069129 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.069453 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.069765 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.070096 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.070530 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.070744 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.071377 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.071826 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.071826 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.072180 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.072423 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.072828 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.073039 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.074124 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.074467 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.074804 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.075122 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.075483 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.075811 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.076746 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.077178 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.077602 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.077888 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_db.sqlalchemy.engines [None req-ade91ea5-884b-49cb-99f0-3396f8ec3607 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117971) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 22:02:19.078009 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.078250 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.078625 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.078945 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.079269 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.079619 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.079943 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.080267 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.080744 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.080935 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.081327 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.081695 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.082118 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.082489 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.082810 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.084843 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.084843 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.084843 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.084843 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.088173 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 22:02:19.088451 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 07 22:02:19.090083 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writer thread running {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 22:02:19.150428 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.context [None req-ade91ea5-884b-49cb-99f0-3396f8ec3607 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5130ba80-aa16-48e5-a7f8-322f7966dcb8(cell1) {{(pid=117971) load_cells /opt/stack/nova/nova/context.py:464}} Jun 07 22:02:19.154885 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ade91ea5-884b-49cb-99f0-3396f8ec3607 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:02:19.156476 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO dbcounter [None req-c710b943-ea6c-42fe-bb64-7cb8d5f75ad5 None None] Registered counter for database nova_api Jun 07 22:02:19.156618 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ade91ea5-884b-49cb-99f0-3396f8ec3607 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:02:19.157414 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ade91ea5-884b-49cb-99f0-3396f8ec3607 None None] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:02:19.159408 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ade91ea5-884b-49cb-99f0-3396f8ec3607 None None] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:02:19.161400 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO dbcounter [None req-ade91ea5-884b-49cb-99f0-3396f8ec3607 None None] Registered counter for database nova_cell0 Jun 07 22:02:19.168151 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO dbcounter [None req-ade91ea5-884b-49cb-99f0-3396f8ec3607 None None] Registered counter for database nova_cell1 Jun 07 22:02:19.175780 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_db.sqlalchemy.engines [None req-ade91ea5-884b-49cb-99f0-3396f8ec3607 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117971) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 22:02:19.178234 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_db.sqlalchemy.engines [None req-ade91ea5-884b-49cb-99f0-3396f8ec3607 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117971) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 22:02:19.181182 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_db.sqlalchemy.engines [None req-c710b943-ea6c-42fe-bb64-7cb8d5f75ad5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117970) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 22:02:19.185932 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writer thread running {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 22:02:19.188854 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writer thread running {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 22:02:19.189754 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writer thread running {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 22:02:19.252974 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.context [None req-c710b943-ea6c-42fe-bb64-7cb8d5f75ad5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5130ba80-aa16-48e5-a7f8-322f7966dcb8(cell1) {{(pid=117970) load_cells /opt/stack/nova/nova/context.py:464}} Jun 07 22:02:19.257329 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c710b943-ea6c-42fe-bb64-7cb8d5f75ad5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:02:19.259044 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c710b943-ea6c-42fe-bb64-7cb8d5f75ad5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:02:19.259902 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c710b943-ea6c-42fe-bb64-7cb8d5f75ad5 None None] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:02:19.261920 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c710b943-ea6c-42fe-bb64-7cb8d5f75ad5 None None] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:02:19.264757 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO dbcounter [None req-c710b943-ea6c-42fe-bb64-7cb8d5f75ad5 None None] Registered counter for database nova_cell0 Jun 07 22:02:19.270647 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO dbcounter [None req-c710b943-ea6c-42fe-bb64-7cb8d5f75ad5 None None] Registered counter for database nova_cell1 Jun 07 22:02:19.280258 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_db.sqlalchemy.engines [None req-c710b943-ea6c-42fe-bb64-7cb8d5f75ad5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117970) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 22:02:19.281502 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_db.sqlalchemy.engines [None req-c710b943-ea6c-42fe-bb64-7cb8d5f75ad5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117970) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 22:02:19.288893 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writer thread running {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 22:02:19.290216 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writer thread running {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 22:02:19.347308 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO dbcounter [None req-ade91ea5-884b-49cb-99f0-3396f8ec3607 None None] Registered counter for database nova_cell0 Jun 07 22:02:19.354722 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_db.sqlalchemy.engines [None req-ade91ea5-884b-49cb-99f0-3396f8ec3607 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117971) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 22:02:19.360071 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writer thread running {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 22:02:19.444417 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO dbcounter [None req-c710b943-ea6c-42fe-bb64-7cb8d5f75ad5 None None] Registered counter for database nova_cell0 Jun 07 22:02:19.451140 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_db.sqlalchemy.engines [None req-c710b943-ea6c-42fe-bb64-7cb8d5f75ad5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117970) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 22:02:19.457173 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writer thread running {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 22:02:19.802172 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: WARNING keystonemiddleware.auth_token [None req-ade91ea5-884b-49cb-99f0-3396f8ec3607 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 07 22:02:19.810132 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: WARNING keystonemiddleware.auth_token [None req-ade91ea5-884b-49cb-99f0-3396f8ec3607 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 07 22:02:19.916537 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: WARNING keystonemiddleware.auth_token [None req-c710b943-ea6c-42fe-bb64-7cb8d5f75ad5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 07 22:02:19.924535 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: WARNING keystonemiddleware.auth_token [None req-c710b943-ea6c-42fe-bb64-7cb8d5f75ad5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 07 22:02:20.040195 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: WARNING keystonemiddleware.auth_token [None req-ade91ea5-884b-49cb-99f0-3396f8ec3607 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 07 22:02:20.046357 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: WARNING keystonemiddleware.auth_token [None req-ade91ea5-884b-49cb-99f0-3396f8ec3607 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 07 22:02:20.051550 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c63cc819c0 pid: 117971 (default app) Jun 07 22:02:20.155894 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: WARNING keystonemiddleware.auth_token [None req-c710b943-ea6c-42fe-bb64-7cb8d5f75ad5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 07 22:02:20.161917 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: WARNING keystonemiddleware.auth_token [None req-c710b943-ea6c-42fe-bb64-7cb8d5f75ad5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 07 22:02:20.166999 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c63cc819c0 pid: 117970 (default app) Jun 07 22:03:02.105218 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_api:SELECT=3 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:03:02.105930 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_cell1:SELECT=3 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:03:02.107468 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_cell0:SELECT=3 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:03:02.108472 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_cell0:SELECT=3 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:03:02.211744 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_api:SELECT=3 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:03:02.213928 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_cell1:SELECT=3 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:03:02.215616 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_cell0:SELECT=3 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:03:02.216574 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_cell0:SELECT=3 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:03:03.187005 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-17a32204-fb20-422a-aad4-5e70abf71392 tempest-VolumesNegativeTest-652737440 tempest-VolumesNegativeTest-652737440-project] Action: 'create', calling method: .version_select at 0x7f92f34a9700>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1229926982", "metadata": {"Type": "work"}}} {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:03:03.203862 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-17a32204-fb20-422a-aad4-5e70abf71392 tempest-VolumesNegativeTest-652737440 tempest-VolumesNegativeTest-652737440-project] Request method failure captured: Jun 07 22:03:03.203862 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 07 22:03:03.203862 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Accept: application/json Jun 07 22:03:03.203862 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Accept-Encoding: identity Jun 07 22:03:03.203862 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Connection: close Jun 07 22:03:03.203862 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Content-Length: 122 Jun 07 22:03:03.203862 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Content-Type: application/json Jun 07 22:03:03.203862 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Host: 10.222.0.13 Jun 07 22:03:03.203862 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Openstack-System-Scope: None Jun 07 22:03:03.203862 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: User-Agent: python-urllib3/1.26.9 Jun 07 22:03:03.203862 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Auth-Token: gAAAAABin8sWLS2qmSNsdD5FlbovuM2d7WE_eVCiVF_G2Fz6qcd_eUsZnoGoo_0JsuzwVAte0q8BEhF_7WJ1hwkCMmiMqnokBnJ7-_Tu4Wyw1704HAHet3Hq6eSo2Nasr4SXBd_xU_WE83HBkPL9g-b-galzZPmu_mnrRKu5WBbMnRf9Ds-u7-Y Jun 07 22:03:03.203862 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Domain-Id: None Jun 07 22:03:03.203862 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Domain-Name: None Jun 07 22:03:03.203862 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Identity-Status: Confirmed Jun 07 22:03:03.203862 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Is-Admin-Project: True Jun 07 22:03:03.203862 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Domain-Id: default Jun 07 22:03:03.203862 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Domain-Name: Default Jun 07 22:03:03.203862 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Id: 3ec97d2dae1f45ed82d63ba7a748cd7d Jun 07 22:03:03.203862 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Name: tempest-VolumesNegativeTest-652737440 Jun 07 22:03:03.203862 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Role: member,reader Jun 07 22:03:03.203862 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Roles: member,reader Jun 07 22:03:03.205589 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3ec97d2dae1f45ed82d63ba7a748cd7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3ec97d2dae1f45ed82d63ba7a748cd7d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3ec97d2dae1f45ed82d63ba7a748cd7d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3ec97d2dae1f45ed82d63ba7a748cd7d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}] Jun 07 22:03:03.205589 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant: tempest-VolumesNegativeTest-652737440 Jun 07 22:03:03.205589 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant-Id: 3ec97d2dae1f45ed82d63ba7a748cd7d Jun 07 22:03:03.205589 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant-Name: tempest-VolumesNegativeTest-652737440 Jun 07 22:03:03.205589 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User: tempest-VolumesNegativeTest-652737440-project Jun 07 22:03:03.205589 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Domain-Id: default Jun 07 22:03:03.205589 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Domain-Name: Default Jun 07 22:03:03.205589 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Id: 9fe11b29cc0e4a78bddc435763a79adb Jun 07 22:03:03.205589 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Name: tempest-VolumesNegativeTest-652737440-project Jun 07 22:03:03.205589 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Jun 07 22:03:03.205589 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1229926982", "metadata": {"Type": "work"}}} Jun 07 22:03:03.205589 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: method: Jun 07 22:03:03.205589 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 07 22:03:03.206596 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1229926982', 'metadata': {'Type': 'work'}}}} Jun 07 22:03:03.206596 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 22:03:03.206596 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:03:03.206596 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 07 22:03:03.206596 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 07 22:03:03.206596 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 07 22:03:03.206596 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise error Jun 07 22:03:03.206596 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 07 22:03:03.206596 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:03:03.206596 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 07 22:03:03.206596 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 07 22:03:03.206596 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:03:03.206596 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 07 22:03:03.206596 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi '#$%' Jun 07 22:03:03.206596 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:03:03.206596 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:03:03.206596 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:03:03.206596 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:03:03.206596 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:03:03.206596 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:03:03.206596 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 22:03:03.206596 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 22:03:03.208224 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 22:03:03.208224 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 22:03:03.208224 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 22:03:03.208224 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 22:03:03.208224 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 07 22:03:03.208224 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 07 22:03:03.208224 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 07 22:03:03.208224 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 07 22:03:03.208224 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 07 22:03:03.208224 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 07 22:03:03.208224 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 07 22:03:03.208224 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:03:03.208224 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:03:03.208224 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:03:03.208224 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:03:03.208224 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:03:03.208224 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:03:03.208224 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 07 22:03:03.208224 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 07 22:03:03.209541 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 07 22:03:03.209541 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:03:03.209541 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-17a32204-fb20-422a-aad4-5e70abf71392 tempest-VolumesNegativeTest-652737440 tempest-VolumesNegativeTest-652737440-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 22:03:03.209541 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-17a32204-fb20-422a-aad4-5e70abf71392 tempest-VolumesNegativeTest-652737440 tempest-VolumesNegativeTest-652737440-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.110597 Jun 07 22:03:03.210699 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 1/1] 10.222.0.13 () {60 vars in 1155 bytes} [Tue Jun 7 22:03:02 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1117 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 07 22:03:03.217138 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-63ad710a-15d5-4c04-b4e4-fa6d19f380ac tempest-VolumesNegativeTest-652737440 tempest-VolumesNegativeTest-652737440-project] Action: 'create', calling method: .version_select at 0x7f92f347a9d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1432634115", "metadata": {"Type": "work"}}} {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:03:03.219833 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-63ad710a-15d5-4c04-b4e4-fa6d19f380ac tempest-VolumesNegativeTest-652737440 tempest-VolumesNegativeTest-652737440-project] Request method failure captured: Jun 07 22:03:03.219833 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 07 22:03:03.219833 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Accept: application/json Jun 07 22:03:03.219833 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Accept-Encoding: identity Jun 07 22:03:03.219833 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Connection: close Jun 07 22:03:03.219833 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Content-Length: 120 Jun 07 22:03:03.219833 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Content-Type: application/json Jun 07 22:03:03.219833 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Host: 10.222.0.13 Jun 07 22:03:03.219833 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Openstack-System-Scope: None Jun 07 22:03:03.219833 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: User-Agent: python-urllib3/1.26.9 Jun 07 22:03:03.219833 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Auth-Token: gAAAAABin8sWLS2qmSNsdD5FlbovuM2d7WE_eVCiVF_G2Fz6qcd_eUsZnoGoo_0JsuzwVAte0q8BEhF_7WJ1hwkCMmiMqnokBnJ7-_Tu4Wyw1704HAHet3Hq6eSo2Nasr4SXBd_xU_WE83HBkPL9g-b-galzZPmu_mnrRKu5WBbMnRf9Ds-u7-Y Jun 07 22:03:03.219833 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Domain-Id: None Jun 07 22:03:03.219833 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Domain-Name: None Jun 07 22:03:03.219833 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Identity-Status: Confirmed Jun 07 22:03:03.219833 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Is-Admin-Project: True Jun 07 22:03:03.219833 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Domain-Id: default Jun 07 22:03:03.219833 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Domain-Name: Default Jun 07 22:03:03.219833 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Id: 3ec97d2dae1f45ed82d63ba7a748cd7d Jun 07 22:03:03.219833 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Name: tempest-VolumesNegativeTest-652737440 Jun 07 22:03:03.219833 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Role: member,reader Jun 07 22:03:03.219833 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Roles: member,reader Jun 07 22:03:03.221363 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3ec97d2dae1f45ed82d63ba7a748cd7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3ec97d2dae1f45ed82d63ba7a748cd7d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3ec97d2dae1f45ed82d63ba7a748cd7d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3ec97d2dae1f45ed82d63ba7a748cd7d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}] Jun 07 22:03:03.221363 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant: tempest-VolumesNegativeTest-652737440 Jun 07 22:03:03.221363 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant-Id: 3ec97d2dae1f45ed82d63ba7a748cd7d Jun 07 22:03:03.221363 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant-Name: tempest-VolumesNegativeTest-652737440 Jun 07 22:03:03.221363 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User: tempest-VolumesNegativeTest-652737440-project Jun 07 22:03:03.221363 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Domain-Id: default Jun 07 22:03:03.221363 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Domain-Name: Default Jun 07 22:03:03.221363 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Id: 9fe11b29cc0e4a78bddc435763a79adb Jun 07 22:03:03.221363 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Name: tempest-VolumesNegativeTest-652737440-project Jun 07 22:03:03.221363 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Jun 07 22:03:03.221363 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1432634115", "metadata": {"Type": "work"}}} Jun 07 22:03:03.221363 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: method: Jun 07 22:03:03.221363 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 07 22:03:03.222295 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1432634115', 'metadata': {'Type': 'work'}}}} Jun 07 22:03:03.222295 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 22:03:03.222295 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:03:03.222295 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 07 22:03:03.222295 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 07 22:03:03.222295 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 07 22:03:03.222295 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise error Jun 07 22:03:03.222295 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 07 22:03:03.222295 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:03:03.222295 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 07 22:03:03.222295 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 07 22:03:03.222295 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:03:03.222295 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 07 22:03:03.222295 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi '0' Jun 07 22:03:03.222295 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:03:03.222295 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:03:03.222295 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:03:03.222295 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:03:03.222295 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:03:03.222295 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:03:03.222295 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 22:03:03.222295 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 22:03:03.223908 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 22:03:03.223908 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 22:03:03.223908 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 22:03:03.223908 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 22:03:03.223908 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 07 22:03:03.223908 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 07 22:03:03.223908 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 07 22:03:03.223908 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 07 22:03:03.223908 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 07 22:03:03.223908 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 07 22:03:03.223908 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 07 22:03:03.223908 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:03:03.223908 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:03:03.223908 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:03:03.223908 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:03:03.223908 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:03:03.223908 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:03:03.223908 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 07 22:03:03.223908 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 07 22:03:03.225101 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 07 22:03:03.225101 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:03:03.225101 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-63ad710a-15d5-4c04-b4e4-fa6d19f380ac tempest-VolumesNegativeTest-652737440 tempest-VolumesNegativeTest-652737440-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 22:03:03.225101 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-63ad710a-15d5-4c04-b4e4-fa6d19f380ac tempest-VolumesNegativeTest-652737440 tempest-VolumesNegativeTest-652737440-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009152 Jun 07 22:03:03.225101 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 2/2] 10.222.0.13 () {60 vars in 1155 bytes} [Tue Jun 7 22:03:03 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 07 22:03:03.252060 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-a7f06cac-42f1-4da3-a8af-052a8406ff92 tempest-VolumesNegativeTest-652737440 tempest-VolumesNegativeTest-652737440-project] Action: 'create', calling method: .version_select at 0x7f92f34a9a60>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2102044290", "metadata": {"Type": "work"}}} {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:03:03.254931 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-a7f06cac-42f1-4da3-a8af-052a8406ff92 tempest-VolumesNegativeTest-652737440 tempest-VolumesNegativeTest-652737440-project] Request method failure captured: Jun 07 22:03:03.254931 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 07 22:03:03.254931 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Accept: application/json Jun 07 22:03:03.254931 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Accept-Encoding: identity Jun 07 22:03:03.254931 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Connection: close Jun 07 22:03:03.254931 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Content-Length: 119 Jun 07 22:03:03.254931 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Content-Type: application/json Jun 07 22:03:03.254931 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Host: 10.222.0.13 Jun 07 22:03:03.254931 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Openstack-System-Scope: None Jun 07 22:03:03.254931 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: User-Agent: python-urllib3/1.26.9 Jun 07 22:03:03.254931 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Auth-Token: gAAAAABin8sWLS2qmSNsdD5FlbovuM2d7WE_eVCiVF_G2Fz6qcd_eUsZnoGoo_0JsuzwVAte0q8BEhF_7WJ1hwkCMmiMqnokBnJ7-_Tu4Wyw1704HAHet3Hq6eSo2Nasr4SXBd_xU_WE83HBkPL9g-b-galzZPmu_mnrRKu5WBbMnRf9Ds-u7-Y Jun 07 22:03:03.254931 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Domain-Id: None Jun 07 22:03:03.254931 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Domain-Name: None Jun 07 22:03:03.254931 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Identity-Status: Confirmed Jun 07 22:03:03.254931 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Is-Admin-Project: True Jun 07 22:03:03.254931 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Domain-Id: default Jun 07 22:03:03.254931 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Domain-Name: Default Jun 07 22:03:03.254931 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Id: 3ec97d2dae1f45ed82d63ba7a748cd7d Jun 07 22:03:03.254931 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Name: tempest-VolumesNegativeTest-652737440 Jun 07 22:03:03.254931 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Role: member,reader Jun 07 22:03:03.254931 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Roles: member,reader Jun 07 22:03:03.256494 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3ec97d2dae1f45ed82d63ba7a748cd7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3ec97d2dae1f45ed82d63ba7a748cd7d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3ec97d2dae1f45ed82d63ba7a748cd7d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3ec97d2dae1f45ed82d63ba7a748cd7d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}] Jun 07 22:03:03.256494 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant: tempest-VolumesNegativeTest-652737440 Jun 07 22:03:03.256494 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant-Id: 3ec97d2dae1f45ed82d63ba7a748cd7d Jun 07 22:03:03.256494 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant-Name: tempest-VolumesNegativeTest-652737440 Jun 07 22:03:03.256494 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User: tempest-VolumesNegativeTest-652737440-project Jun 07 22:03:03.256494 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Domain-Id: default Jun 07 22:03:03.256494 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Domain-Name: Default Jun 07 22:03:03.256494 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Id: 9fe11b29cc0e4a78bddc435763a79adb Jun 07 22:03:03.256494 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Name: tempest-VolumesNegativeTest-652737440-project Jun 07 22:03:03.256494 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Jun 07 22:03:03.256494 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2102044290", "metadata": {"Type": "work"}}} Jun 07 22:03:03.256494 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: method: Jun 07 22:03:03.256494 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 07 22:03:03.257591 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-2102044290', 'metadata': {'Type': 'work'}}}} Jun 07 22:03:03.257591 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 22:03:03.257591 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:03:03.257591 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 07 22:03:03.257591 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 07 22:03:03.257591 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 07 22:03:03.257591 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise error Jun 07 22:03:03.257591 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 07 22:03:03.257591 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:03:03.257591 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 07 22:03:03.257591 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 07 22:03:03.257591 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:03:03.257591 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 07 22:03:03.257591 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi '' Jun 07 22:03:03.257591 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:03:03.257591 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:03:03.257591 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:03:03.257591 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:03:03.257591 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:03:03.257591 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:03:03.257591 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 22:03:03.257591 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 22:03:03.259229 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 22:03:03.259229 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 22:03:03.259229 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 22:03:03.259229 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 22:03:03.259229 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 07 22:03:03.259229 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 07 22:03:03.259229 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 07 22:03:03.259229 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 07 22:03:03.259229 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 07 22:03:03.259229 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 07 22:03:03.259229 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 07 22:03:03.259229 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:03:03.259229 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:03:03.259229 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:03:03.259229 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:03:03.259229 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:03:03.259229 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:03:03.259229 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 07 22:03:03.259229 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 07 22:03:03.260587 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 07 22:03:03.260587 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:03:03.260587 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-a7f06cac-42f1-4da3-a8af-052a8406ff92 tempest-VolumesNegativeTest-652737440 tempest-VolumesNegativeTest-652737440-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 22:03:03.261597 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-a7f06cac-42f1-4da3-a8af-052a8406ff92 tempest-VolumesNegativeTest-652737440 tempest-VolumesNegativeTest-652737440-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.027093 Jun 07 22:03:03.267596 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 3/3] 10.222.0.13 () {60 vars in 1155 bytes} [Tue Jun 7 22:03:03 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 07 22:03:03.272894 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-5d90e0ce-942b-4d42-9319-f1684ce016e3 tempest-VolumesNegativeTest-652737440 tempest-VolumesNegativeTest-652737440-project] Calling method '.version_select at 0x7f92f33d6700>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:03.348146 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-e9c1e274-02f2-4b0a-a2ab-69caa579dcfa tempest-VolumesGetTestJSON-2022539368 tempest-VolumesGetTestJSON-2022539368-project] Action: 'create', calling method: .version_select at 0x7f92f34a9700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-555350046", "metadata": {"Type": "work"}}} {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:03:04.063201 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.wsgi [None req-5d90e0ce-942b-4d42-9319-f1684ce016e3 tempest-VolumesNegativeTest-652737440 tempest-VolumesNegativeTest-652737440-project] HTTP exception thrown: Volume tempest-invalid-1938025820 could not be found. Jun 07 22:03:04.067192 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-5d90e0ce-942b-4d42-9319-f1684ce016e3 tempest-VolumesNegativeTest-652737440 tempest-VolumesNegativeTest-652737440-project] Request method failure captured: Jun 07 22:03:04.067192 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1938025820 HTTP/1.1 Jun 07 22:03:04.067192 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Accept: application/json Jun 07 22:03:04.067192 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Accept-Encoding: identity Jun 07 22:03:04.067192 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Connection: close Jun 07 22:03:04.067192 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Content-Length: 0 Jun 07 22:03:04.067192 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Content-Type: application/json Jun 07 22:03:04.067192 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Host: 10.222.0.13 Jun 07 22:03:04.067192 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Openstack-System-Scope: None Jun 07 22:03:04.067192 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: User-Agent: python-urllib3/1.26.9 Jun 07 22:03:04.067192 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Auth-Token: gAAAAABin8sWLS2qmSNsdD5FlbovuM2d7WE_eVCiVF_G2Fz6qcd_eUsZnoGoo_0JsuzwVAte0q8BEhF_7WJ1hwkCMmiMqnokBnJ7-_Tu4Wyw1704HAHet3Hq6eSo2Nasr4SXBd_xU_WE83HBkPL9g-b-galzZPmu_mnrRKu5WBbMnRf9Ds-u7-Y Jun 07 22:03:04.067192 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Domain-Id: None Jun 07 22:03:04.067192 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Domain-Name: None Jun 07 22:03:04.067192 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Identity-Status: Confirmed Jun 07 22:03:04.067192 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Is-Admin-Project: True Jun 07 22:03:04.067192 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Domain-Id: default Jun 07 22:03:04.067192 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Domain-Name: Default Jun 07 22:03:04.067192 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Id: 3ec97d2dae1f45ed82d63ba7a748cd7d Jun 07 22:03:04.067192 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Name: tempest-VolumesNegativeTest-652737440 Jun 07 22:03:04.067192 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Role: member,reader Jun 07 22:03:04.067192 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Roles: member,reader Jun 07 22:03:04.068940 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3ec97d2dae1f45ed82d63ba7a748cd7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3ec97d2dae1f45ed82d63ba7a748cd7d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3ec97d2dae1f45ed82d63ba7a748cd7d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3ec97d2dae1f45ed82d63ba7a748cd7d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}] Jun 07 22:03:04.068940 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant: tempest-VolumesNegativeTest-652737440 Jun 07 22:03:04.068940 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant-Id: 3ec97d2dae1f45ed82d63ba7a748cd7d Jun 07 22:03:04.068940 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant-Name: tempest-VolumesNegativeTest-652737440 Jun 07 22:03:04.068940 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User: tempest-VolumesNegativeTest-652737440-project Jun 07 22:03:04.068940 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Domain-Id: default Jun 07 22:03:04.068940 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Domain-Name: Default Jun 07 22:03:04.068940 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Id: 9fe11b29cc0e4a78bddc435763a79adb Jun 07 22:03:04.068940 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Name: tempest-VolumesNegativeTest-652737440-project Jun 07 22:03:04.068940 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: method: Jun 07 22:03:04.068940 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: exception: Volume tempest-invalid-1938025820 could not be found. Jun 07 22:03:04.068940 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: action_args: {'id': 'tempest-invalid-1938025820'} Jun 07 22:03:04.068940 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 22:03:04.069760 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:03:04.069760 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 22:03:04.069760 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 22:03:04.069760 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 07 22:03:04.069760 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 07 22:03:04.069760 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 07 22:03:04.069760 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 07 22:03:04.069760 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 07 22:03:04.069760 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 07 22:03:04.069760 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 07 22:03:04.069760 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 07 22:03:04.069760 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 22:03:04.069760 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 22:03:04.069760 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 22:03:04.069760 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 22:03:04.069760 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1938025820 could not be found. (HTTP 404) (Request-ID: req-037e9cbd-a894-4380-b48f-58bffa3b9c21) Jun 07 22:03:04.069760 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:03:04.069760 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:03:04.069760 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:03:04.071035 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:03:04.071035 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 07 22:03:04.071035 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 07 22:03:04.071035 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 07 22:03:04.071035 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 07 22:03:04.071035 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 07 22:03:04.071035 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 07 22:03:04.071035 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 07 22:03:04.071035 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 07 22:03:04.071035 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 22:03:04.071035 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 22:03:04.071035 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 07 22:03:04.071035 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 07 22:03:04.071035 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 07 22:03:04.071035 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 07 22:03:04.071035 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 07 22:03:04.071035 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 07 22:03:04.071035 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 07 22:03:04.071035 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 07 22:03:04.072440 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 22:03:04.072440 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 22:03:04.072440 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 22:03:04.072440 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 22:03:04.072440 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1938025820 could not be found. Jun 07 22:03:04.072440 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:03:04.072440 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:03:04.072440 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:03:04.072440 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:03:04.072440 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:03:04.072440 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:03:04.072440 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 22:03:04.072440 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 22:03:04.072440 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 22:03:04.072440 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 22:03:04.072440 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 22:03:04.072440 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 22:03:04.072440 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 07 22:03:04.072440 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 22:03:04.072440 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1938025820 could not be found. Jun 07 22:03:04.073859 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:03:04.073859 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:03:04.073859 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:03:04.073859 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:03:04.073859 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:03:04.073859 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:03:04.073859 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 22:03:04.073859 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 22:03:04.073859 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1938025820 could not be found. Jun 07 22:03:04.073859 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:03:04.075464 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-5d90e0ce-942b-4d42-9319-f1684ce016e3 tempest-VolumesNegativeTest-652737440 tempest-VolumesNegativeTest-652737440-project] Returning 404 to user: Volume tempest-invalid-1938025820 could not be found. {{(pid=117971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 22:03:04.076831 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-5d90e0ce-942b-4d42-9319-f1684ce016e3 tempest-VolumesNegativeTest-652737440 tempest-VolumesNegativeTest-652737440-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1938025820" status: 404 len: 99 microversion: 2.1 time: 0.808113 Jun 07 22:03:04.080859 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 4/4] 10.222.0.13 () {58 vars in 1217 bytes} [Tue Jun 7 22:03:03 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1938025820 => generated 99 bytes in 813 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 07 22:03:04.090932 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-31f17407-6b92-4603-8589-da32fb0d2661 tempest-VolumesNegativeTest-652737440 tempest-VolumesNegativeTest-652737440-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004696 Jun 07 22:03:04.091904 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 5/5] 10.222.0.13 () {58 vars in 1139 bytes} [Tue Jun 7 22:03:04 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 07 22:03:04.121770 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-892e59d7-8f88-4466-bc4c-2bb89820749c tempest-VolumesNegativeTest-652737440 tempest-VolumesNegativeTest-652737440-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.019213 Jun 07 22:03:04.129780 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 6/6] 10.222.0.13 () {58 vars in 1136 bytes} [Tue Jun 7 22:03:04 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 30 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 07 22:03:04.138215 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-3b52fa72-f9e6-4df2-bf84-30f3cbb9e76c tempest-VolumesNegativeTest-652737440 tempest-VolumesNegativeTest-652737440-project] Calling method '.version_select at 0x7f92f330b550>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:04.394585 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.wsgi [None req-3b52fa72-f9e6-4df2-bf84-30f3cbb9e76c tempest-VolumesNegativeTest-652737440 tempest-VolumesNegativeTest-652737440-project] HTTP exception thrown: Volume 221bf641-c7a2-4b03-b9e3-0220d69ae9f2 could not be found. Jun 07 22:03:04.398321 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-3b52fa72-f9e6-4df2-bf84-30f3cbb9e76c tempest-VolumesNegativeTest-652737440 tempest-VolumesNegativeTest-652737440-project] Request method failure captured: Jun 07 22:03:04.398321 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: request: DELETE /compute/v2.1/os-volumes/221bf641-c7a2-4b03-b9e3-0220d69ae9f2 HTTP/1.1 Jun 07 22:03:04.398321 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Accept: application/json Jun 07 22:03:04.398321 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Accept-Encoding: identity Jun 07 22:03:04.398321 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Connection: close Jun 07 22:03:04.398321 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Content-Length: 0 Jun 07 22:03:04.398321 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Content-Type: application/json Jun 07 22:03:04.398321 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Host: 10.222.0.13 Jun 07 22:03:04.398321 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Openstack-System-Scope: None Jun 07 22:03:04.398321 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: User-Agent: python-urllib3/1.26.9 Jun 07 22:03:04.398321 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Auth-Token: gAAAAABin8sWLS2qmSNsdD5FlbovuM2d7WE_eVCiVF_G2Fz6qcd_eUsZnoGoo_0JsuzwVAte0q8BEhF_7WJ1hwkCMmiMqnokBnJ7-_Tu4Wyw1704HAHet3Hq6eSo2Nasr4SXBd_xU_WE83HBkPL9g-b-galzZPmu_mnrRKu5WBbMnRf9Ds-u7-Y Jun 07 22:03:04.398321 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Domain-Id: None Jun 07 22:03:04.398321 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Domain-Name: None Jun 07 22:03:04.398321 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Identity-Status: Confirmed Jun 07 22:03:04.398321 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Is-Admin-Project: True Jun 07 22:03:04.398321 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Domain-Id: default Jun 07 22:03:04.398321 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Domain-Name: Default Jun 07 22:03:04.398321 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Id: 3ec97d2dae1f45ed82d63ba7a748cd7d Jun 07 22:03:04.398321 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Name: tempest-VolumesNegativeTest-652737440 Jun 07 22:03:04.398321 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Role: member,reader Jun 07 22:03:04.398321 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Roles: member,reader Jun 07 22:03:04.399825 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3ec97d2dae1f45ed82d63ba7a748cd7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3ec97d2dae1f45ed82d63ba7a748cd7d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3ec97d2dae1f45ed82d63ba7a748cd7d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3ec97d2dae1f45ed82d63ba7a748cd7d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}] Jun 07 22:03:04.399825 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant: tempest-VolumesNegativeTest-652737440 Jun 07 22:03:04.399825 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant-Id: 3ec97d2dae1f45ed82d63ba7a748cd7d Jun 07 22:03:04.399825 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant-Name: tempest-VolumesNegativeTest-652737440 Jun 07 22:03:04.399825 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User: tempest-VolumesNegativeTest-652737440-project Jun 07 22:03:04.399825 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Domain-Id: default Jun 07 22:03:04.399825 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Domain-Name: Default Jun 07 22:03:04.399825 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Id: 9fe11b29cc0e4a78bddc435763a79adb Jun 07 22:03:04.399825 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Name: tempest-VolumesNegativeTest-652737440-project Jun 07 22:03:04.399825 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: method: Jun 07 22:03:04.399825 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: exception: Volume 221bf641-c7a2-4b03-b9e3-0220d69ae9f2 could not be found. Jun 07 22:03:04.399825 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: action_args: {'id': '221bf641-c7a2-4b03-b9e3-0220d69ae9f2'} Jun 07 22:03:04.399825 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 22:03:04.400765 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:03:04.400765 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 22:03:04.400765 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 22:03:04.400765 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 07 22:03:04.400765 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 07 22:03:04.400765 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 07 22:03:04.400765 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 07 22:03:04.400765 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 07 22:03:04.400765 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 07 22:03:04.400765 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 07 22:03:04.400765 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 07 22:03:04.400765 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 22:03:04.400765 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 22:03:04.400765 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 22:03:04.400765 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 22:03:04.400765 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 221bf641-c7a2-4b03-b9e3-0220d69ae9f2 could not be found. (HTTP 404) (Request-ID: req-5ca92d2b-a7f0-409e-bb38-066fa6dca146) Jun 07 22:03:04.400765 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:03:04.400765 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:03:04.400765 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:03:04.401899 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:03:04.401899 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 07 22:03:04.401899 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 07 22:03:04.401899 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 07 22:03:04.401899 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 07 22:03:04.401899 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 07 22:03:04.401899 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 07 22:03:04.401899 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 07 22:03:04.401899 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 07 22:03:04.401899 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 22:03:04.401899 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 22:03:04.401899 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 07 22:03:04.401899 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 07 22:03:04.401899 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 07 22:03:04.401899 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 07 22:03:04.401899 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 07 22:03:04.401899 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 07 22:03:04.401899 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 07 22:03:04.401899 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 07 22:03:04.403212 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 22:03:04.403212 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 22:03:04.403212 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 22:03:04.403212 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 22:03:04.403212 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 221bf641-c7a2-4b03-b9e3-0220d69ae9f2 could not be found. Jun 07 22:03:04.403212 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:03:04.403212 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:03:04.403212 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:03:04.403212 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:03:04.403212 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:03:04.403212 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:03:04.403212 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 22:03:04.403212 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 22:03:04.403212 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 22:03:04.403212 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 22:03:04.403212 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 22:03:04.403212 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 22:03:04.403212 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 07 22:03:04.403212 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 22:03:04.404387 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 221bf641-c7a2-4b03-b9e3-0220d69ae9f2 could not be found. Jun 07 22:03:04.404387 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:03:04.404387 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:03:04.404387 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:03:04.404387 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:03:04.404387 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:03:04.404387 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:03:04.404387 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 22:03:04.404387 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 22:03:04.404387 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 221bf641-c7a2-4b03-b9e3-0220d69ae9f2 could not be found. Jun 07 22:03:04.404387 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:03:04.407222 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-3b52fa72-f9e6-4df2-bf84-30f3cbb9e76c tempest-VolumesNegativeTest-652737440 tempest-VolumesNegativeTest-652737440-project] Returning 404 to user: Volume 221bf641-c7a2-4b03-b9e3-0220d69ae9f2 could not be found. {{(pid=117971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 22:03:04.408302 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-3b52fa72-f9e6-4df2-bf84-30f3cbb9e76c tempest-VolumesNegativeTest-652737440 tempest-VolumesNegativeTest-652737440-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/221bf641-c7a2-4b03-b9e3-0220d69ae9f2" status: 404 len: 109 microversion: 2.1 time: 0.277530 Jun 07 22:03:04.413535 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 7/7] 10.222.0.13 () {58 vars in 1247 bytes} [Tue Jun 7 22:03:04 2022] DELETE /compute/v2.1/os-volumes/221bf641-c7a2-4b03-b9e3-0220d69ae9f2 => generated 109 bytes in 283 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 22:03:04.420941 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-b9c04d51-2176-4399-8f0e-07a9f6d6a1b8 tempest-VolumesNegativeTest-652737440 tempest-VolumesNegativeTest-652737440-project] Calling method '.version_select at 0x7f92f330b310>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:04.566602 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.wsgi [None req-b9c04d51-2176-4399-8f0e-07a9f6d6a1b8 tempest-VolumesNegativeTest-652737440 tempest-VolumesNegativeTest-652737440-project] HTTP exception thrown: Volume 5c61de04-352a-4a4b-8291-ccd275ea7c8a could not be found. Jun 07 22:03:04.568629 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-b9c04d51-2176-4399-8f0e-07a9f6d6a1b8 tempest-VolumesNegativeTest-652737440 tempest-VolumesNegativeTest-652737440-project] Request method failure captured: Jun 07 22:03:04.568629 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: request: GET /compute/v2.1/os-volumes/5c61de04-352a-4a4b-8291-ccd275ea7c8a HTTP/1.1 Jun 07 22:03:04.568629 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Accept: application/json Jun 07 22:03:04.568629 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Accept-Encoding: identity Jun 07 22:03:04.568629 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Connection: close Jun 07 22:03:04.568629 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Content-Length: 0 Jun 07 22:03:04.568629 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Content-Type: application/json Jun 07 22:03:04.568629 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Host: 10.222.0.13 Jun 07 22:03:04.568629 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Openstack-System-Scope: None Jun 07 22:03:04.568629 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: User-Agent: python-urllib3/1.26.9 Jun 07 22:03:04.568629 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Auth-Token: gAAAAABin8sWLS2qmSNsdD5FlbovuM2d7WE_eVCiVF_G2Fz6qcd_eUsZnoGoo_0JsuzwVAte0q8BEhF_7WJ1hwkCMmiMqnokBnJ7-_Tu4Wyw1704HAHet3Hq6eSo2Nasr4SXBd_xU_WE83HBkPL9g-b-galzZPmu_mnrRKu5WBbMnRf9Ds-u7-Y Jun 07 22:03:04.568629 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Domain-Id: None Jun 07 22:03:04.568629 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Domain-Name: None Jun 07 22:03:04.568629 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Identity-Status: Confirmed Jun 07 22:03:04.568629 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Is-Admin-Project: True Jun 07 22:03:04.568629 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Domain-Id: default Jun 07 22:03:04.568629 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Domain-Name: Default Jun 07 22:03:04.568629 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Id: 3ec97d2dae1f45ed82d63ba7a748cd7d Jun 07 22:03:04.568629 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Name: tempest-VolumesNegativeTest-652737440 Jun 07 22:03:04.568629 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Role: member,reader Jun 07 22:03:04.568629 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Roles: member,reader Jun 07 22:03:04.570167 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3ec97d2dae1f45ed82d63ba7a748cd7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3ec97d2dae1f45ed82d63ba7a748cd7d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3ec97d2dae1f45ed82d63ba7a748cd7d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3ec97d2dae1f45ed82d63ba7a748cd7d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}] Jun 07 22:03:04.570167 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant: tempest-VolumesNegativeTest-652737440 Jun 07 22:03:04.570167 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant-Id: 3ec97d2dae1f45ed82d63ba7a748cd7d Jun 07 22:03:04.570167 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant-Name: tempest-VolumesNegativeTest-652737440 Jun 07 22:03:04.570167 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User: tempest-VolumesNegativeTest-652737440-project Jun 07 22:03:04.570167 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Domain-Id: default Jun 07 22:03:04.570167 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Domain-Name: Default Jun 07 22:03:04.570167 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Id: 9fe11b29cc0e4a78bddc435763a79adb Jun 07 22:03:04.570167 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Name: tempest-VolumesNegativeTest-652737440-project Jun 07 22:03:04.570167 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: method: Jun 07 22:03:04.570167 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: exception: Volume 5c61de04-352a-4a4b-8291-ccd275ea7c8a could not be found. Jun 07 22:03:04.570167 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: action_args: {'id': '5c61de04-352a-4a4b-8291-ccd275ea7c8a'} Jun 07 22:03:04.570167 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 22:03:04.571094 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:03:04.571094 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 22:03:04.571094 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 22:03:04.571094 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 07 22:03:04.571094 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 07 22:03:04.571094 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 07 22:03:04.571094 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 07 22:03:04.571094 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 22:03:04.571094 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 22:03:04.571094 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 22:03:04.571094 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 22:03:04.571094 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 22:03:04.571094 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 22:03:04.571094 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 22:03:04.571094 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 22:03:04.571094 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5c61de04-352a-4a4b-8291-ccd275ea7c8a could not be found. (HTTP 404) (Request-ID: req-c25b83e6-5fd6-4277-911c-c0c8f79a9665) Jun 07 22:03:04.571094 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:03:04.571094 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:03:04.571094 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:03:04.572498 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:03:04.572498 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 07 22:03:04.572498 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 07 22:03:04.572498 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 07 22:03:04.572498 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 07 22:03:04.572498 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 07 22:03:04.572498 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 07 22:03:04.572498 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 07 22:03:04.572498 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 07 22:03:04.572498 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 22:03:04.572498 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 22:03:04.572498 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 07 22:03:04.572498 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 07 22:03:04.572498 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 07 22:03:04.572498 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 07 22:03:04.572498 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 22:03:04.572498 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 22:03:04.572498 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 22:03:04.572498 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 22:03:04.573752 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 22:03:04.573752 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 22:03:04.573752 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 22:03:04.573752 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 22:03:04.573752 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5c61de04-352a-4a4b-8291-ccd275ea7c8a could not be found. Jun 07 22:03:04.573752 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:03:04.573752 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:03:04.573752 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:03:04.573752 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:03:04.573752 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:03:04.573752 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:03:04.573752 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 22:03:04.573752 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 22:03:04.573752 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 22:03:04.573752 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 22:03:04.573752 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 22:03:04.573752 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 22:03:04.573752 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 07 22:03:04.573752 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 22:03:04.575495 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5c61de04-352a-4a4b-8291-ccd275ea7c8a could not be found. Jun 07 22:03:04.575495 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:03:04.575495 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:03:04.575495 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:03:04.575495 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:03:04.575495 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:03:04.575495 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:03:04.575495 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 22:03:04.575495 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 22:03:04.575495 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5c61de04-352a-4a4b-8291-ccd275ea7c8a could not be found. Jun 07 22:03:04.575495 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:03:04.575495 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-b9c04d51-2176-4399-8f0e-07a9f6d6a1b8 tempest-VolumesNegativeTest-652737440 tempest-VolumesNegativeTest-652737440-project] Returning 404 to user: Volume 5c61de04-352a-4a4b-8291-ccd275ea7c8a could not be found. {{(pid=117971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 22:03:04.575495 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-b9c04d51-2176-4399-8f0e-07a9f6d6a1b8 tempest-VolumesNegativeTest-652737440 tempest-VolumesNegativeTest-652737440-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/5c61de04-352a-4a4b-8291-ccd275ea7c8a" status: 404 len: 109 microversion: 2.1 time: 0.155423 Jun 07 22:03:04.580269 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 8/8] 10.222.0.13 () {58 vars in 1244 bytes} [Tue Jun 7 22:03:04 2022] GET /compute/v2.1/os-volumes/5c61de04-352a-4a4b-8291-ccd275ea7c8a => generated 109 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 22:03:05.026977 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-e9c1e274-02f2-4b0a-a2ab-69caa579dcfa tempest-VolumesGetTestJSON-2022539368 tempest-VolumesGetTestJSON-2022539368-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 2.824190 Jun 07 22:03:05.030334 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 1/9] 10.222.0.13 () {60 vars in 1155 bytes} [Tue Jun 7 22:03:02 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 2829 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 07 22:03:05.044523 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-087f000a-cba2-4976-b622-129048a86e30 tempest-VolumesGetTestJSON-2022539368 tempest-VolumesGetTestJSON-2022539368-project] Calling method '.version_select at 0x7f92f330b8b0>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:05.212533 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-087f000a-cba2-4976-b622-129048a86e30 tempest-VolumesGetTestJSON-2022539368 tempest-VolumesGetTestJSON-2022539368-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/7ca3cce5-5501-450a-9890-e58b57c8692a" status: 200 len: 352 microversion: 2.1 time: 0.174382 Jun 07 22:03:05.213336 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 9/10] 10.222.0.13 () {58 vars in 1244 bytes} [Tue Jun 7 22:03:05 2022] GET /compute/v2.1/os-volumes/7ca3cce5-5501-450a-9890-e58b57c8692a => generated 352 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:03:06.175652 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-eee4bda1-6f3e-409e-b912-85eeaf51dea1 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-621886802", "imageRef": "87e2e140-6de8-4531-9681-d0a3e069622d", "flavorRef": "452", "networks": [{"uuid": "43c76d0b-e7f7-497e-97df-daa2fe824d0b"}]}} {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:03:06.226442 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-3e82d196-01ec-4bea-a2d7-d915dec1a4df tempest-VolumesGetTestJSON-2022539368 tempest-VolumesGetTestJSON-2022539368-project] Calling method '.version_select at 0x7f92f330b5e0>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:06.330936 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.network.neutron [None req-eee4bda1-6f3e-409e-b912-85eeaf51dea1 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] validate_networks() for [('43c76d0b-e7f7-497e-97df-daa2fe824d0b', None, None, None, None, None)] {{(pid=117970) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 22:03:06.353221 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-3e82d196-01ec-4bea-a2d7-d915dec1a4df tempest-VolumesGetTestJSON-2022539368 tempest-VolumesGetTestJSON-2022539368-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/7ca3cce5-5501-450a-9890-e58b57c8692a" status: 200 len: 352 microversion: 2.1 time: 0.130932 Jun 07 22:03:06.354163 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 10/11] 10.222.0.13 () {58 vars in 1244 bytes} [Tue Jun 7 22:03:06 2022] GET /compute/v2.1/os-volumes/7ca3cce5-5501-450a-9890-e58b57c8692a => generated 352 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:03:07.367704 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-80f9836d-f5bb-4671-a94d-8614510229e5 tempest-VolumesGetTestJSON-2022539368 tempest-VolumesGetTestJSON-2022539368-project] Calling method '.version_select at 0x7f92f3313670>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:07.516622 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-80f9836d-f5bb-4671-a94d-8614510229e5 tempest-VolumesGetTestJSON-2022539368 tempest-VolumesGetTestJSON-2022539368-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/7ca3cce5-5501-450a-9890-e58b57c8692a" status: 200 len: 353 microversion: 2.1 time: 0.154467 Jun 07 22:03:07.517346 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 11/12] 10.222.0.13 () {58 vars in 1244 bytes} [Tue Jun 7 22:03:07 2022] GET /compute/v2.1/os-volumes/7ca3cce5-5501-450a-9890-e58b57c8692a => generated 353 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 22:03:07.529088 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-ebb2290e-bcce-4f5a-883d-4c38d6f98c07 tempest-VolumesGetTestJSON-2022539368 tempest-VolumesGetTestJSON-2022539368-project] Calling method '.version_select at 0x7f92f3313d30>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:07.661386 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-ebb2290e-bcce-4f5a-883d-4c38d6f98c07 tempest-VolumesGetTestJSON-2022539368 tempest-VolumesGetTestJSON-2022539368-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/7ca3cce5-5501-450a-9890-e58b57c8692a" status: 200 len: 353 microversion: 2.1 time: 0.136060 Jun 07 22:03:07.662235 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 12/13] 10.222.0.13 () {58 vars in 1244 bytes} [Tue Jun 7 22:03:07 2022] GET /compute/v2.1/os-volumes/7ca3cce5-5501-450a-9890-e58b57c8692a => generated 353 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 22:03:07.684150 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-aa07c1b1-1606-4520-a45a-4a11c6a4efa8 tempest-VolumesGetTestJSON-2022539368 tempest-VolumesGetTestJSON-2022539368-project] Calling method '.version_select at 0x7f92f3313820>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:07.896440 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-aa07c1b1-1606-4520-a45a-4a11c6a4efa8 tempest-VolumesGetTestJSON-2022539368 tempest-VolumesGetTestJSON-2022539368-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/7ca3cce5-5501-450a-9890-e58b57c8692a" status: 202 len: 0 microversion: 2.1 time: 0.217238 Jun 07 22:03:07.897167 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 13/14] 10.222.0.13 () {58 vars in 1247 bytes} [Tue Jun 7 22:03:07 2022] DELETE /compute/v2.1/os-volumes/7ca3cce5-5501-450a-9890-e58b57c8692a => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 07 22:03:07.906119 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-a0f3e3d8-0c4a-41e1-ad51-38da5f54a3a1 tempest-VolumesGetTestJSON-2022539368 tempest-VolumesGetTestJSON-2022539368-project] Calling method '.version_select at 0x7f92f3313160>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:08.018413 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-a0f3e3d8-0c4a-41e1-ad51-38da5f54a3a1 tempest-VolumesGetTestJSON-2022539368 tempest-VolumesGetTestJSON-2022539368-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/7ca3cce5-5501-450a-9890-e58b57c8692a" status: 200 len: 352 microversion: 2.1 time: 0.117022 Jun 07 22:03:08.018976 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 14/15] 10.222.0.13 () {58 vars in 1244 bytes} [Tue Jun 7 22:03:07 2022] GET /compute/v2.1/os-volumes/7ca3cce5-5501-450a-9890-e58b57c8692a => generated 352 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 22:03:09.031764 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-53ea1b76-41ac-4339-ae98-9401ff6ed161 tempest-VolumesGetTestJSON-2022539368 tempest-VolumesGetTestJSON-2022539368-project] Calling method '.version_select at 0x7f92f330b430>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:09.091757 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.wsgi [None req-53ea1b76-41ac-4339-ae98-9401ff6ed161 tempest-VolumesGetTestJSON-2022539368 tempest-VolumesGetTestJSON-2022539368-project] HTTP exception thrown: Volume 7ca3cce5-5501-450a-9890-e58b57c8692a could not be found. Jun 07 22:03:09.093712 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-53ea1b76-41ac-4339-ae98-9401ff6ed161 tempest-VolumesGetTestJSON-2022539368 tempest-VolumesGetTestJSON-2022539368-project] Request method failure captured: Jun 07 22:03:09.093712 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: request: GET /compute/v2.1/os-volumes/7ca3cce5-5501-450a-9890-e58b57c8692a HTTP/1.1 Jun 07 22:03:09.093712 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Accept: application/json Jun 07 22:03:09.093712 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Accept-Encoding: identity Jun 07 22:03:09.093712 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Connection: close Jun 07 22:03:09.093712 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Content-Length: 0 Jun 07 22:03:09.093712 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Content-Type: application/json Jun 07 22:03:09.093712 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Host: 10.222.0.13 Jun 07 22:03:09.093712 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Openstack-System-Scope: None Jun 07 22:03:09.093712 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: User-Agent: python-urllib3/1.26.9 Jun 07 22:03:09.093712 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Auth-Token: gAAAAABin8sW6UrZdyP76N9sbpOXqYF8TkNdCGKaaXP-A3FGpLpzP6qmpwOoTb9Xzhmurba8pr_SVxwHwc5D3aGhh1kU9ZarspuUzfU0dvSuuu0sXqrFi3Aw4KwMcH2KwhKJFUf8WZA3PK9I4b5PldKlvvJd8gqMfvQZL2jFRpbmdy40-VF61Bg Jun 07 22:03:09.093712 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Domain-Id: None Jun 07 22:03:09.093712 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Domain-Name: None Jun 07 22:03:09.093712 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Identity-Status: Confirmed Jun 07 22:03:09.093712 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Is-Admin-Project: True Jun 07 22:03:09.093712 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Domain-Id: default Jun 07 22:03:09.093712 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Domain-Name: Default Jun 07 22:03:09.093712 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Id: 4637b625bf8245038c9606f3e4b0bcd4 Jun 07 22:03:09.093712 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Name: tempest-VolumesGetTestJSON-2022539368 Jun 07 22:03:09.093712 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Role: member,reader Jun 07 22:03:09.093712 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Roles: member,reader Jun 07 22:03:09.094731 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4637b625bf8245038c9606f3e4b0bcd4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4637b625bf8245038c9606f3e4b0bcd4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4637b625bf8245038c9606f3e4b0bcd4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4637b625bf8245038c9606f3e4b0bcd4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}] Jun 07 22:03:09.094731 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant: tempest-VolumesGetTestJSON-2022539368 Jun 07 22:03:09.094731 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant-Id: 4637b625bf8245038c9606f3e4b0bcd4 Jun 07 22:03:09.094731 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant-Name: tempest-VolumesGetTestJSON-2022539368 Jun 07 22:03:09.094731 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User: tempest-VolumesGetTestJSON-2022539368-project Jun 07 22:03:09.094731 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Domain-Id: default Jun 07 22:03:09.094731 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Domain-Name: Default Jun 07 22:03:09.094731 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Id: 17ce5e31e7724b77ab47c52ee0d3021e Jun 07 22:03:09.094731 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Name: tempest-VolumesGetTestJSON-2022539368-project Jun 07 22:03:09.094731 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: method: Jun 07 22:03:09.094731 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: exception: Volume 7ca3cce5-5501-450a-9890-e58b57c8692a could not be found. Jun 07 22:03:09.094731 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: action_args: {'id': '7ca3cce5-5501-450a-9890-e58b57c8692a'} Jun 07 22:03:09.094731 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 22:03:09.095392 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:03:09.095392 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 22:03:09.095392 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 22:03:09.095392 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 07 22:03:09.095392 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 07 22:03:09.095392 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 07 22:03:09.095392 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 07 22:03:09.095392 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 22:03:09.095392 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 22:03:09.095392 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 22:03:09.095392 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 22:03:09.095392 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 22:03:09.095392 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 22:03:09.095392 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 22:03:09.095392 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 22:03:09.095392 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7ca3cce5-5501-450a-9890-e58b57c8692a could not be found. (HTTP 404) (Request-ID: req-05cd80be-a2a9-4bc5-aa50-19f13d5d515e) Jun 07 22:03:09.095392 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:03:09.095392 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:03:09.095392 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:03:09.096248 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:03:09.096248 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 07 22:03:09.096248 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 07 22:03:09.096248 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 07 22:03:09.096248 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 07 22:03:09.096248 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 07 22:03:09.096248 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 07 22:03:09.096248 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 07 22:03:09.096248 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 07 22:03:09.096248 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 22:03:09.096248 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 22:03:09.096248 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 07 22:03:09.096248 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 07 22:03:09.096248 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 07 22:03:09.096248 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 07 22:03:09.096248 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 22:03:09.096248 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 22:03:09.096248 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 22:03:09.096248 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 22:03:09.097110 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 22:03:09.097110 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 22:03:09.097110 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 22:03:09.097110 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 22:03:09.097110 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7ca3cce5-5501-450a-9890-e58b57c8692a could not be found. Jun 07 22:03:09.097110 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:03:09.097110 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:03:09.097110 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:03:09.097110 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:03:09.097110 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:03:09.097110 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:03:09.097110 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 22:03:09.097110 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 22:03:09.097110 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 22:03:09.097110 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 22:03:09.097110 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 22:03:09.097110 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 22:03:09.097110 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 07 22:03:09.097110 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 22:03:09.097952 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7ca3cce5-5501-450a-9890-e58b57c8692a could not be found. Jun 07 22:03:09.097952 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:03:09.097952 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:03:09.097952 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:03:09.097952 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:03:09.097952 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:03:09.097952 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:03:09.097952 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 22:03:09.097952 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 22:03:09.097952 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7ca3cce5-5501-450a-9890-e58b57c8692a could not be found. Jun 07 22:03:09.097952 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:03:09.097952 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-53ea1b76-41ac-4339-ae98-9401ff6ed161 tempest-VolumesGetTestJSON-2022539368 tempest-VolumesGetTestJSON-2022539368-project] Returning 404 to user: Volume 7ca3cce5-5501-450a-9890-e58b57c8692a could not be found. {{(pid=117971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 22:03:09.097952 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-53ea1b76-41ac-4339-ae98-9401ff6ed161 tempest-VolumesGetTestJSON-2022539368 tempest-VolumesGetTestJSON-2022539368-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/7ca3cce5-5501-450a-9890-e58b57c8692a" status: 404 len: 109 microversion: 2.1 time: 0.068906 Jun 07 22:03:09.097952 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 15/16] 10.222.0.13 () {58 vars in 1244 bytes} [Tue Jun 7 22:03:09 2022] GET /compute/v2.1/os-volumes/7ca3cce5-5501-450a-9890-e58b57c8692a => generated 109 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 22:03:10.298539 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.virt.hardware [None req-eee4bda1-6f3e-409e-b912-85eeaf51dea1 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Flavor limits 0:0:0 {{(pid=117970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 22:03:10.299168 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.virt.hardware [None req-eee4bda1-6f3e-409e-b912-85eeaf51dea1 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Image limits 0:0:0 {{(pid=117970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 22:03:10.300023 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.virt.hardware [None req-eee4bda1-6f3e-409e-b912-85eeaf51dea1 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Flavor pref 0:0:0 {{(pid=117970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 22:03:10.300482 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.virt.hardware [None req-eee4bda1-6f3e-409e-b912-85eeaf51dea1 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Image pref 0:0:0 {{(pid=117970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 22:03:10.300932 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.virt.hardware [None req-eee4bda1-6f3e-409e-b912-85eeaf51dea1 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 22:03:10.340839 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-eee4bda1-6f3e-409e-b912-85eeaf51dea1 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:10.341296 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-eee4bda1-6f3e-409e-b912-85eeaf51dea1 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:10.342101 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-eee4bda1-6f3e-409e-b912-85eeaf51dea1 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:10.346754 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-eee4bda1-6f3e-409e-b912-85eeaf51dea1 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:10.423126 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.quota [None req-eee4bda1-6f3e-409e-b912-85eeaf51dea1 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Getting quotas for project 7e8d5b4fdf9a48a296359e167017123f. Resources: {'cores', 'ram', 'instances'} {{(pid=117970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 22:03:10.447132 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.quota [None req-eee4bda1-6f3e-409e-b912-85eeaf51dea1 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Getting quotas for user 1378a898f9534635857e5958d32f00c5 and project 7e8d5b4fdf9a48a296359e167017123f. Resources: {'cores', 'ram', 'instances'} {{(pid=117970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 22:03:10.491350 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-eee4bda1-6f3e-409e-b912-85eeaf51dea1 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Going to run 1 instances... {{(pid=117970) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 22:03:10.499689 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-eee4bda1-6f3e-409e-b912-85eeaf51dea1 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] [instance: b6a3577d-4aaf-4947-95c1-873076371ae7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='87e2e140-6de8-4531-9681-d0a3e069622d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 22:03:10.685701 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-eee4bda1-6f3e-409e-b912-85eeaf51dea1 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.877413 Jun 07 22:03:10.686496 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 2/17] 10.222.0.13 () {60 vars in 1146 bytes} [Tue Jun 7 22:03:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 4880 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 22:03:10.697200 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-04511462-0ed7-428c-b599-10e050d5e293 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:10.697948 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-04511462-0ed7-428c-b599-10e050d5e293 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] [instance: b6a3577d-4aaf-4947-95c1-873076371ae7] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:11.195232 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-04511462-0ed7-428c-b599-10e050d5e293 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1378a898f9534635857e5958d32f00c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8d5b4fdf9a48a296359e167017123f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:11.227841 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-04511462-0ed7-428c-b599-10e050d5e293 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] 10.222.0.13 "GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7" status: 200 len: 1214 microversion: 2.1 time: 0.532710 Jun 07 22:03:11.230474 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 16/18] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:10 2022] GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7 => generated 1214 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:03:12.249946 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-1e81cdee-e398-430f-b139-3ca95d63c0b5 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:12.251287 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-1e81cdee-e398-430f-b139-3ca95d63c0b5 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] [instance: b6a3577d-4aaf-4947-95c1-873076371ae7] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:12.920078 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-1e81cdee-e398-430f-b139-3ca95d63c0b5 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1378a898f9534635857e5958d32f00c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8d5b4fdf9a48a296359e167017123f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:12.977194 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-1e81cdee-e398-430f-b139-3ca95d63c0b5 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] 10.222.0.13 "GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7" status: 200 len: 1214 microversion: 2.1 time: 0.730422 Jun 07 22:03:12.980685 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 3/19] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:12 2022] GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7 => generated 1214 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:03:13.994364 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-1c760476-a546-46cd-aaf0-659ea3cde7b2 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:13.996140 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-1c760476-a546-46cd-aaf0-659ea3cde7b2 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] [instance: b6a3577d-4aaf-4947-95c1-873076371ae7] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:14.005990 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-1c760476-a546-46cd-aaf0-659ea3cde7b2 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:14.007705 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-1c760476-a546-46cd-aaf0-659ea3cde7b2 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:14.010900 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-1c760476-a546-46cd-aaf0-659ea3cde7b2 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:14.013003 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-1c760476-a546-46cd-aaf0-659ea3cde7b2 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:14.399204 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-1c760476-a546-46cd-aaf0-659ea3cde7b2 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1378a898f9534635857e5958d32f00c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8d5b4fdf9a48a296359e167017123f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:14.434671 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-1c760476-a546-46cd-aaf0-659ea3cde7b2 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] 10.222.0.13 "GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7" status: 200 len: 1266 microversion: 2.1 time: 0.443774 Jun 07 22:03:14.435269 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 17/20] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:13 2022] GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7 => generated 1266 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:03:15.453115 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-340e57aa-67d4-4c34-9d4e-664b60ea8fad tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:15.453753 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-340e57aa-67d4-4c34-9d4e-664b60ea8fad tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] [instance: b6a3577d-4aaf-4947-95c1-873076371ae7] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:15.473704 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-340e57aa-67d4-4c34-9d4e-664b60ea8fad tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:15.474195 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-340e57aa-67d4-4c34-9d4e-664b60ea8fad tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:15.475008 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-340e57aa-67d4-4c34-9d4e-664b60ea8fad tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:15.475467 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-340e57aa-67d4-4c34-9d4e-664b60ea8fad tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:15.754687 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-f01a0b12-637b-46fe-8202-b2e76f1bf2ca tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1476273566", "imageRef": "87e2e140-6de8-4531-9681-d0a3e069622d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:03:15.842252 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-340e57aa-67d4-4c34-9d4e-664b60ea8fad tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1378a898f9534635857e5958d32f00c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8d5b4fdf9a48a296359e167017123f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:15.854042 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-340e57aa-67d4-4c34-9d4e-664b60ea8fad tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] 10.222.0.13 "GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7" status: 200 len: 1272 microversion: 2.1 time: 0.406494 Jun 07 22:03:15.855641 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 18/21] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:15 2022] GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7 => generated 1272 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:03:15.934713 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.network.neutron [None req-f01a0b12-637b-46fe-8202-b2e76f1bf2ca tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] validate_networks() for [('7ce3c4b5-2104-47b7-8f97-31211d4fa728', None, None, None, None, None)] {{(pid=117970) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 22:03:16.873628 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-9c1e9de4-6ec6-43db-91e5-c1e7ea92f4f0 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:16.874238 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-9c1e9de4-6ec6-43db-91e5-c1e7ea92f4f0 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] [instance: b6a3577d-4aaf-4947-95c1-873076371ae7] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:16.885060 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-9c1e9de4-6ec6-43db-91e5-c1e7ea92f4f0 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:16.885507 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-9c1e9de4-6ec6-43db-91e5-c1e7ea92f4f0 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:16.886903 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-9c1e9de4-6ec6-43db-91e5-c1e7ea92f4f0 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:16.887358 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-9c1e9de4-6ec6-43db-91e5-c1e7ea92f4f0 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:18.000388 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-9c1e9de4-6ec6-43db-91e5-c1e7ea92f4f0 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1378a898f9534635857e5958d32f00c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8d5b4fdf9a48a296359e167017123f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:18.012549 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-9c1e9de4-6ec6-43db-91e5-c1e7ea92f4f0 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] 10.222.0.13 "GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7" status: 200 len: 1314 microversion: 2.1 time: 1.143461 Jun 07 22:03:18.019355 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 19/22] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:16 2022] GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7 => generated 1314 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:03:18.859637 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.virt.hardware [None req-f01a0b12-637b-46fe-8202-b2e76f1bf2ca tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Flavor limits 0:0:0 {{(pid=117970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 22:03:18.860868 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.virt.hardware [None req-f01a0b12-637b-46fe-8202-b2e76f1bf2ca tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Image limits 0:0:0 {{(pid=117970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 22:03:18.861565 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.virt.hardware [None req-f01a0b12-637b-46fe-8202-b2e76f1bf2ca tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Flavor pref 0:0:0 {{(pid=117970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 22:03:18.862155 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.virt.hardware [None req-f01a0b12-637b-46fe-8202-b2e76f1bf2ca tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Image pref 0:0:0 {{(pid=117970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 22:03:18.862972 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.virt.hardware [None req-f01a0b12-637b-46fe-8202-b2e76f1bf2ca tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 22:03:18.881501 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f01a0b12-637b-46fe-8202-b2e76f1bf2ca tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:18.882203 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f01a0b12-637b-46fe-8202-b2e76f1bf2ca tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:18.906390 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f01a0b12-637b-46fe-8202-b2e76f1bf2ca tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:18.907247 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f01a0b12-637b-46fe-8202-b2e76f1bf2ca tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:19.002109 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.quota [None req-f01a0b12-637b-46fe-8202-b2e76f1bf2ca tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Getting quotas for project 0a4fc48a5efe4d8b974757a5bf7d947e. Resources: {'cores', 'ram', 'instances'} {{(pid=117970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 22:03:19.034654 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.quota [None req-f01a0b12-637b-46fe-8202-b2e76f1bf2ca tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Getting quotas for user c44c1788959e4b339c9cd5aad4318496 and project 0a4fc48a5efe4d8b974757a5bf7d947e. Resources: {'cores', 'ram', 'instances'} {{(pid=117970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 22:03:19.035298 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-4b1fab3b-3eae-4fac-ab5d-cb227525b651 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:19.035943 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-4b1fab3b-3eae-4fac-ab5d-cb227525b651 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] [instance: b6a3577d-4aaf-4947-95c1-873076371ae7] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:19.065661 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-4b1fab3b-3eae-4fac-ab5d-cb227525b651 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:19.071766 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-4b1fab3b-3eae-4fac-ab5d-cb227525b651 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:19.073922 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-f01a0b12-637b-46fe-8202-b2e76f1bf2ca tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Going to run 1 instances... {{(pid=117970) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 22:03:19.074058 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-4b1fab3b-3eae-4fac-ab5d-cb227525b651 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:19.074542 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-4b1fab3b-3eae-4fac-ab5d-cb227525b651 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:19.108040 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-f01a0b12-637b-46fe-8202-b2e76f1bf2ca tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 92b3a56b-7d09-4772-b1e4-c75b3971f7a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='87e2e140-6de8-4531-9681-d0a3e069622d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 22:03:19.294359 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-f01a0b12-637b-46fe-8202-b2e76f1bf2ca tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.295601 Jun 07 22:03:19.306587 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 4/23] 10.222.0.13 () {60 vars in 1146 bytes} [Tue Jun 7 22:03:14 2022] POST /compute/v2.1/servers => generated 383 bytes in 4311 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 22:03:19.318848 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-985247d7-a6fc-4a28-a953-d0642f8ee944 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:19.328467 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-985247d7-a6fc-4a28-a953-d0642f8ee944 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 92b3a56b-7d09-4772-b1e4-c75b3971f7a5] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:19.997740 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-985247d7-a6fc-4a28-a953-d0642f8ee944 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:20.033257 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-985247d7-a6fc-4a28-a953-d0642f8ee944 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/92b3a56b-7d09-4772-b1e4-c75b3971f7a5" status: 200 len: 1222 microversion: 2.1 time: 0.700372 Jun 07 22:03:20.037211 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 5/24] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:19 2022] GET /compute/v2.1/servers/92b3a56b-7d09-4772-b1e4-c75b3971f7a5 => generated 1222 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:03:20.505481 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-f2c8b611-25d8-4ce0-bbea-c0981cf2fd37 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-875087362", "imageRef": "87e2e140-6de8-4531-9681-d0a3e069622d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:03:20.697728 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.network.neutron [None req-f2c8b611-25d8-4ce0-bbea-c0981cf2fd37 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] validate_networks() for [('7ce3c4b5-2104-47b7-8f97-31211d4fa728', None, None, None, None, None)] {{(pid=117970) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 22:03:20.954127 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-4b1fab3b-3eae-4fac-ab5d-cb227525b651 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1378a898f9534635857e5958d32f00c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8d5b4fdf9a48a296359e167017123f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:20.968026 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-4b1fab3b-3eae-4fac-ab5d-cb227525b651 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] 10.222.0.13 "GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7" status: 200 len: 1314 microversion: 2.1 time: 1.936412 Jun 07 22:03:20.968609 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 20/25] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:19 2022] GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7 => generated 1314 bytes in 1938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:03:21.986972 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-03c45b2a-8db4-4994-8bd2-a9ff21a76036 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:21.987624 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-03c45b2a-8db4-4994-8bd2-a9ff21a76036 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] [instance: b6a3577d-4aaf-4947-95c1-873076371ae7] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:21.989859 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_cell0:SELECT=2 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:03:22.002660 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-03c45b2a-8db4-4994-8bd2-a9ff21a76036 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:22.004457 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-03c45b2a-8db4-4994-8bd2-a9ff21a76036 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:22.005290 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-03c45b2a-8db4-4994-8bd2-a9ff21a76036 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:22.005730 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-03c45b2a-8db4-4994-8bd2-a9ff21a76036 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:22.492683 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-03c45b2a-8db4-4994-8bd2-a9ff21a76036 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1378a898f9534635857e5958d32f00c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8d5b4fdf9a48a296359e167017123f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:22.501448 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-03c45b2a-8db4-4994-8bd2-a9ff21a76036 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] 10.222.0.13 "GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7" status: 200 len: 1314 microversion: 2.1 time: 0.519039 Jun 07 22:03:22.528086 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 21/26] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:21 2022] GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7 => generated 1314 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:03:23.595615 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [req-4a71f3e6-6ff7-43a0-b12a-b161d38a01e2 req-2e588f35-a4c1-415d-9c2a-4e2518f67c0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6a3577d-4aaf-4947-95c1-873076371ae7", "tag": "013cdc82-ff69-4ef3-8efc-580732459589"}]} {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:03:23.618057 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-4a71f3e6-6ff7-43a0-b12a-b161d38a01e2 req-2e588f35-a4c1-415d-9c2a-4e2518f67c0a service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:23.618520 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-4a71f3e6-6ff7-43a0-b12a-b161d38a01e2 req-2e588f35-a4c1-415d-9c2a-4e2518f67c0a service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:23.654899 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.virt.hardware [None req-f2c8b611-25d8-4ce0-bbea-c0981cf2fd37 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Flavor limits 0:0:0 {{(pid=117970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 22:03:23.655992 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.virt.hardware [None req-f2c8b611-25d8-4ce0-bbea-c0981cf2fd37 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Image limits 0:0:0 {{(pid=117970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 22:03:23.656783 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.virt.hardware [None req-f2c8b611-25d8-4ce0-bbea-c0981cf2fd37 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Flavor pref 0:0:0 {{(pid=117970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 22:03:23.658290 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.virt.hardware [None req-f2c8b611-25d8-4ce0-bbea-c0981cf2fd37 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Image pref 0:0:0 {{(pid=117970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 22:03:23.659237 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.virt.hardware [None req-f2c8b611-25d8-4ce0-bbea-c0981cf2fd37 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 22:03:23.679195 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f2c8b611-25d8-4ce0-bbea-c0981cf2fd37 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:23.681273 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f2c8b611-25d8-4ce0-bbea-c0981cf2fd37 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:23.684425 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f2c8b611-25d8-4ce0-bbea-c0981cf2fd37 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:23.685077 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f2c8b611-25d8-4ce0-bbea-c0981cf2fd37 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:23.694029 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.compute.server_external_events [req-4a71f3e6-6ff7-43a0-b12a-b161d38a01e2 req-2e588f35-a4c1-415d-9c2a-4e2518f67c0a service nova] Creating event network-changed:013cdc82-ff69-4ef3-8efc-580732459589 for instance b6a3577d-4aaf-4947-95c1-873076371ae7 on hv-cinder-83552 Jun 07 22:03:23.695006 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-4a71f3e6-6ff7-43a0-b12a-b161d38a01e2 req-2e588f35-a4c1-415d-9c2a-4e2518f67c0a service nova] Acquired lock "compute-rpcapi-router" {{(pid=117971) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 07 22:03:23.696745 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a8e76517-0391-4725-8770-eabd51389572 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:23.704746 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a8e76517-0391-4725-8770-eabd51389572 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:23.706412 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a8e76517-0391-4725-8770-eabd51389572 None None] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:23.707119 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a8e76517-0391-4725-8770-eabd51389572 None None] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:23.746146 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.compute.rpcapi [None req-a8e76517-0391-4725-8770-eabd51389572 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 07 22:03:23.749466 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a8e76517-0391-4725-8770-eabd51389572 None None] Releasing lock "compute-rpcapi-router" {{(pid=117971) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 07 22:03:23.785632 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.quota [None req-f2c8b611-25d8-4ce0-bbea-c0981cf2fd37 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Getting quotas for project 0a4fc48a5efe4d8b974757a5bf7d947e. Resources: {'cores', 'ram', 'instances'} {{(pid=117970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 22:03:23.806218 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.quota [None req-f2c8b611-25d8-4ce0-bbea-c0981cf2fd37 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Getting quotas for user c44c1788959e4b339c9cd5aad4318496 and project 0a4fc48a5efe4d8b974757a5bf7d947e. Resources: {'cores', 'ram', 'instances'} {{(pid=117970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 22:03:23.813696 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-a8e76517-0391-4725-8770-eabd51389572 None None] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.777009 Jun 07 22:03:23.817589 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 22/27] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:03:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 22:03:23.838381 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-7878ff38-00e5-4370-aa6b-49edd7db12f1 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:23.842784 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-7878ff38-00e5-4370-aa6b-49edd7db12f1 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] [instance: b6a3577d-4aaf-4947-95c1-873076371ae7] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:23.861871 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-f2c8b611-25d8-4ce0-bbea-c0981cf2fd37 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Going to run 1 instances... {{(pid=117970) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 22:03:23.870376 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-f2c8b611-25d8-4ce0-bbea-c0981cf2fd37 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='87e2e140-6de8-4531-9681-d0a3e069622d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 22:03:23.871088 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-7878ff38-00e5-4370-aa6b-49edd7db12f1 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:23.880321 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-7878ff38-00e5-4370-aa6b-49edd7db12f1 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:23.882458 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-7878ff38-00e5-4370-aa6b-49edd7db12f1 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:23.884365 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-7878ff38-00e5-4370-aa6b-49edd7db12f1 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:24.041353 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-f2c8b611-25d8-4ce0-bbea-c0981cf2fd37 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.541423 Jun 07 22:03:24.050165 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 6/28] 10.222.0.13 () {60 vars in 1146 bytes} [Tue Jun 7 22:03:20 2022] POST /compute/v2.1/servers => generated 383 bytes in 3551 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 22:03:24.278227 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-7878ff38-00e5-4370-aa6b-49edd7db12f1 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1378a898f9534635857e5958d32f00c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8d5b4fdf9a48a296359e167017123f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:24.290934 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-7878ff38-00e5-4370-aa6b-49edd7db12f1 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] 10.222.0.13 "GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7" status: 200 len: 1314 microversion: 2.1 time: 0.468908 Jun 07 22:03:24.291562 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 23/29] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:23 2022] GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7 => generated 1314 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:03:24.305935 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-366d3c5f-0919-4d2c-8cb0-8e3b90a3677b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:24.306712 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-366d3c5f-0919-4d2c-8cb0-8e3b90a3677b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:24.477106 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-366d3c5f-0919-4d2c-8cb0-8e3b90a3677b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:24.494528 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-366d3c5f-0919-4d2c-8cb0-8e3b90a3677b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1221 microversion: 2.1 time: 0.198297 Jun 07 22:03:24.506589 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 24/30] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:24 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1221 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:03:24.625976 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-ad48c6aa-ce5d-43a3-a7b0-a107031e063f tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Action: 'create', calling method: .version_select at 0x7f92f2242160>, body: {"keypair": {"name": "tempest-keypair-1587080771", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHfJdUR0GRFPxLFCPetOZustJaIEeBx1dr51UbqPvPqA0MgoLfRgCPH8maljxOSMjLMK2KYJ8cMVuml5RDbVQsx8fbJVAzVuOOsvdt5kgVgTWtlQjDMHYjEHHAAcE9hT1A=="}} {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:03:24.696711 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.quota [None req-ad48c6aa-ce5d-43a3-a7b0-a107031e063f tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Getting quotas for project 49d73c22e28a450a99d0952aa686dccf. Resources: {'key_pairs'} {{(pid=117970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 22:03:24.713098 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.quota [None req-ad48c6aa-ce5d-43a3-a7b0-a107031e063f tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Getting quotas for user 607b70b4d6e14c95ae2880dd3577c8ae and project 49d73c22e28a450a99d0952aa686dccf. Resources: {'key_pairs'} {{(pid=117970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 22:03:24.834650 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-ad48c6aa-ce5d-43a3-a7b0-a107031e063f tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.781548 Jun 07 22:03:24.835888 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 7/31] 10.222.0.13 () {60 vars in 1158 bytes} [Tue Jun 7 22:03:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:03:25.308409 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-4195a05d-e367-4baf-8cbc-c9dafc051e78 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:25.310466 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-4195a05d-e367-4baf-8cbc-c9dafc051e78 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] [instance: b6a3577d-4aaf-4947-95c1-873076371ae7] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:25.325277 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-4195a05d-e367-4baf-8cbc-c9dafc051e78 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:25.336828 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-4195a05d-e367-4baf-8cbc-c9dafc051e78 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:25.337844 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-4195a05d-e367-4baf-8cbc-c9dafc051e78 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:25.338369 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-4195a05d-e367-4baf-8cbc-c9dafc051e78 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:25.523860 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-769088f6-c242-4eb1-b001-7222cf479419 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:25.525042 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-769088f6-c242-4eb1-b001-7222cf479419 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:25.568447 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-769088f6-c242-4eb1-b001-7222cf479419 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:25.568927 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-769088f6-c242-4eb1-b001-7222cf479419 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:25.572926 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-769088f6-c242-4eb1-b001-7222cf479419 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:25.598434 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-769088f6-c242-4eb1-b001-7222cf479419 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:25.988000 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-769088f6-c242-4eb1-b001-7222cf479419 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:26.008032 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-769088f6-c242-4eb1-b001-7222cf479419 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1225 microversion: 2.1 time: 0.489316 Jun 07 22:03:26.019002 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 8/32] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:25 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1225 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:03:26.198865 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-4195a05d-e367-4baf-8cbc-c9dafc051e78 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1378a898f9534635857e5958d32f00c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8d5b4fdf9a48a296359e167017123f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:26.248067 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-4195a05d-e367-4baf-8cbc-c9dafc051e78 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] 10.222.0.13 "GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7" status: 200 len: 1314 microversion: 2.1 time: 0.944202 Jun 07 22:03:26.251998 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 25/33] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:25 2022] GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7 => generated 1314 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:03:26.412450 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-dcebdacf-66e2-4386-ad1d-ef39b347a5f1 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Action: 'create', calling method: .version_select at 0x7f92f21dcca0>, body: {"keypair": {"name": "tempest-keypair-406503496", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKxEWcfz9wFIaqZD7RF/7EOzOp4C/PTBLPu9hoDVeIZwVdAzzN3ekfr5fdI4w4uakIzKubpeR5sfB1ObwpKpN1ic37y7FYspSImu0w1WEAI3q2IJ96bFI/BJWPSAIuumsw=="}} {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:03:26.434587 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.quota [None req-dcebdacf-66e2-4386-ad1d-ef39b347a5f1 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Getting quotas for project d32f58b7303541388483ca4b881a552e. Resources: {'key_pairs'} {{(pid=117970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 22:03:26.440043 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.quota [None req-dcebdacf-66e2-4386-ad1d-ef39b347a5f1 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Getting quotas for user 0e68eff6a08d4193b3167d47f4e1f97c and project d32f58b7303541388483ca4b881a552e. Resources: {'key_pairs'} {{(pid=117970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 22:03:26.479837 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-dcebdacf-66e2-4386-ad1d-ef39b347a5f1 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.459158 Jun 07 22:03:26.482843 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 9/34] 10.222.0.13 () {60 vars in 1158 bytes} [Tue Jun 7 22:03:26 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:03:27.025889 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-87f383dd-b790-42f9-bf09-04f4a5dc513e tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:27.026720 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-87f383dd-b790-42f9-bf09-04f4a5dc513e tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:27.038479 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-87f383dd-b790-42f9-bf09-04f4a5dc513e tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:27.038939 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-87f383dd-b790-42f9-bf09-04f4a5dc513e tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:27.039737 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-87f383dd-b790-42f9-bf09-04f4a5dc513e tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:27.040156 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-87f383dd-b790-42f9-bf09-04f4a5dc513e tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:27.236922 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-87f383dd-b790-42f9-bf09-04f4a5dc513e tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:27.250696 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-87f383dd-b790-42f9-bf09-04f4a5dc513e tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1225 microversion: 2.1 time: 0.228520 Jun 07 22:03:27.268610 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 26/35] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:27 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1225 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:03:27.276222 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-1f301971-cc0f-4d87-9b53-46f799b9d646 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:27.277139 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-1f301971-cc0f-4d87-9b53-46f799b9d646 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] [instance: b6a3577d-4aaf-4947-95c1-873076371ae7] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:27.306150 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1f301971-cc0f-4d87-9b53-46f799b9d646 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:27.306841 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1f301971-cc0f-4d87-9b53-46f799b9d646 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:27.310846 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1f301971-cc0f-4d87-9b53-46f799b9d646 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:27.313215 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1f301971-cc0f-4d87-9b53-46f799b9d646 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:28.276148 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-f6573e81-070b-4fbe-919e-5108cc1740e5 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:28.278641 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-f6573e81-070b-4fbe-919e-5108cc1740e5 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:28.295725 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-f6573e81-070b-4fbe-919e-5108cc1740e5 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:28.297818 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-f6573e81-070b-4fbe-919e-5108cc1740e5 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:28.300731 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-f6573e81-070b-4fbe-919e-5108cc1740e5 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:28.302523 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-f6573e81-070b-4fbe-919e-5108cc1740e5 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:28.589458 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-f6573e81-070b-4fbe-919e-5108cc1740e5 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:28.644395 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-f6573e81-070b-4fbe-919e-5108cc1740e5 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1225 microversion: 2.1 time: 0.367467 Jun 07 22:03:28.657839 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 27/36] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:28 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1225 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:03:29.556367 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-1f301971-cc0f-4d87-9b53-46f799b9d646 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1378a898f9534635857e5958d32f00c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8d5b4fdf9a48a296359e167017123f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:29.569417 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-1f301971-cc0f-4d87-9b53-46f799b9d646 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] 10.222.0.13 "GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7" status: 200 len: 1314 microversion: 2.1 time: 2.305286 Jun 07 22:03:29.587489 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 10/37] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:27 2022] GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7 => generated 1314 bytes in 2324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:03:29.665667 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-c879ffab-cfa5-46f3-8a79-64910010a5dc tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:29.666526 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-c879ffab-cfa5-46f3-8a79-64910010a5dc tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:29.689133 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c879ffab-cfa5-46f3-8a79-64910010a5dc tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:29.691830 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c879ffab-cfa5-46f3-8a79-64910010a5dc tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:29.696757 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c879ffab-cfa5-46f3-8a79-64910010a5dc tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:29.703709 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c879ffab-cfa5-46f3-8a79-64910010a5dc tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:30.227029 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-c879ffab-cfa5-46f3-8a79-64910010a5dc tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:30.239103 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-c879ffab-cfa5-46f3-8a79-64910010a5dc tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1273 microversion: 2.1 time: 0.579735 Jun 07 22:03:30.239736 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 28/38] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:29 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1273 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:03:30.607242 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-8ff6da1c-6dd5-495c-bcde-7b17fceb91a2 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:30.607242 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-8ff6da1c-6dd5-495c-bcde-7b17fceb91a2 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] [instance: b6a3577d-4aaf-4947-95c1-873076371ae7] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:30.616703 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-8ff6da1c-6dd5-495c-bcde-7b17fceb91a2 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:30.618180 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-8ff6da1c-6dd5-495c-bcde-7b17fceb91a2 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:30.619959 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-8ff6da1c-6dd5-495c-bcde-7b17fceb91a2 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:30.623542 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-8ff6da1c-6dd5-495c-bcde-7b17fceb91a2 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:31.060643 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-8ff6da1c-6dd5-495c-bcde-7b17fceb91a2 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1378a898f9534635857e5958d32f00c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8d5b4fdf9a48a296359e167017123f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:31.093428 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-8ff6da1c-6dd5-495c-bcde-7b17fceb91a2 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] 10.222.0.13 "GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7" status: 200 len: 1314 microversion: 2.1 time: 0.498797 Jun 07 22:03:31.096324 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 11/39] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:30 2022] GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7 => generated 1314 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:03:31.259734 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-174fb4cf-1411-49eb-83aa-90d5783e63ff tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:31.262307 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-174fb4cf-1411-49eb-83aa-90d5783e63ff tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:31.282452 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-174fb4cf-1411-49eb-83aa-90d5783e63ff tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:31.285513 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-174fb4cf-1411-49eb-83aa-90d5783e63ff tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:31.286534 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-174fb4cf-1411-49eb-83aa-90d5783e63ff tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:31.287063 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-174fb4cf-1411-49eb-83aa-90d5783e63ff tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:31.544909 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-174fb4cf-1411-49eb-83aa-90d5783e63ff tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:31.556060 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-174fb4cf-1411-49eb-83aa-90d5783e63ff tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1273 microversion: 2.1 time: 0.302150 Jun 07 22:03:31.576868 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 29/40] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:31 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1273 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:03:31.939960 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-557aa0d8-c043-408e-8f7b-4f4f0837165d tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1318439276", "imageRef": "87e2e140-6de8-4531-9681-d0a3e069622d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7dfa279a-8a9f-49b5-8669-931f3a43bf9f"}], "security_groups": [{"name": "tempest-securitygroup--1416325258"}], "key_name": "tempest-keypair-1587080771", "user_data": "}} {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:03:32.114197 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-37715ae7-ced4-469a-ab52-8ce7b1154db1 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:32.115243 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-37715ae7-ced4-469a-ab52-8ce7b1154db1 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] [instance: b6a3577d-4aaf-4947-95c1-873076371ae7] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:32.135425 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-37715ae7-ced4-469a-ab52-8ce7b1154db1 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:32.142526 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-37715ae7-ced4-469a-ab52-8ce7b1154db1 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:32.145057 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-37715ae7-ced4-469a-ab52-8ce7b1154db1 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:32.147555 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-37715ae7-ced4-469a-ab52-8ce7b1154db1 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:32.239290 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.network.neutron [None req-557aa0d8-c043-408e-8f7b-4f4f0837165d tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] validate_networks() for [('7dfa279a-8a9f-49b5-8669-931f3a43bf9f', None, None, None, None, None)] {{(pid=117970) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 22:03:32.560830 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-37715ae7-ced4-469a-ab52-8ce7b1154db1 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1378a898f9534635857e5958d32f00c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8d5b4fdf9a48a296359e167017123f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:32.571217 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-37715ae7-ced4-469a-ab52-8ce7b1154db1 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] 10.222.0.13 "GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7" status: 200 len: 1314 microversion: 2.1 time: 0.461325 Jun 07 22:03:32.576167 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 30/41] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:32 2022] GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7 => generated 1314 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:03:32.583872 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-926b815f-445d-4422-ae71-620d6d900198 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-90755486", "imageRef": "87e2e140-6de8-4531-9681-d0a3e069622d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fb5585d7-4dbe-44e8-b38e-d8afe1080b96"}], "security_groups": [{"name": "tempest-securitygroup--587121011"}], "key_name": "tempest-keypair-406503496", "user_data": "}} {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:03:32.600034 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=11 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:03:32.633941 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_api:SELECT=35 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:03:32.806822 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.network.neutron [None req-926b815f-445d-4422-ae71-620d6d900198 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] validate_networks() for [('fb5585d7-4dbe-44e8-b38e-d8afe1080b96', None, None, None, None, None)] {{(pid=117971) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 22:03:32.867382 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.virt.hardware [None req-557aa0d8-c043-408e-8f7b-4f4f0837165d tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Flavor limits 0:0:0 {{(pid=117970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 22:03:32.867879 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.virt.hardware [None req-557aa0d8-c043-408e-8f7b-4f4f0837165d tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Image limits 0:0:0 {{(pid=117970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 22:03:32.868574 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.virt.hardware [None req-557aa0d8-c043-408e-8f7b-4f4f0837165d tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Flavor pref 0:0:0 {{(pid=117970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 22:03:32.869182 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.virt.hardware [None req-557aa0d8-c043-408e-8f7b-4f4f0837165d tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Image pref 0:0:0 {{(pid=117970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 22:03:32.869792 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.virt.hardware [None req-557aa0d8-c043-408e-8f7b-4f4f0837165d tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 22:03:32.878871 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_cell0:SELECT=31 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:03:32.891539 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-557aa0d8-c043-408e-8f7b-4f4f0837165d tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:32.892260 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-557aa0d8-c043-408e-8f7b-4f4f0837165d tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:32.895079 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-557aa0d8-c043-408e-8f7b-4f4f0837165d tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:32.895644 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-557aa0d8-c043-408e-8f7b-4f4f0837165d tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:32.904673 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_cell0:SELECT=7 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:03:32.905974 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_cell1:SELECT=25 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:03:32.919845 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.quota [None req-557aa0d8-c043-408e-8f7b-4f4f0837165d tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Getting quotas for project 49d73c22e28a450a99d0952aa686dccf. Resources: {'cores', 'ram', 'instances'} {{(pid=117970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 22:03:32.924521 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.quota [None req-557aa0d8-c043-408e-8f7b-4f4f0837165d tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Getting quotas for user 607b70b4d6e14c95ae2880dd3577c8ae and project 49d73c22e28a450a99d0952aa686dccf. Resources: {'cores', 'ram', 'instances'} {{(pid=117970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 22:03:32.936957 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-557aa0d8-c043-408e-8f7b-4f4f0837165d tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Going to run 1 instances... {{(pid=117970) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 22:03:32.939109 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-557aa0d8-c043-408e-8f7b-4f4f0837165d tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 5704eeef-7ef8-4e6d-b39d-d672e9592836] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='87e2e140-6de8-4531-9681-d0a3e069622d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 22:03:32.991681 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-557aa0d8-c043-408e-8f7b-4f4f0837165d tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.056942 Jun 07 22:03:32.998534 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 12/42] 10.222.0.13 () {60 vars in 1146 bytes} [Tue Jun 7 22:03:31 2022] POST /compute/v2.1/servers => generated 402 bytes in 1065 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 22:03:33.006974 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-21d03322-cb5f-46ad-b392-f424564b6ba1 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:33.007807 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-21d03322-cb5f-46ad-b392-f424564b6ba1 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:33.015620 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-21d03322-cb5f-46ad-b392-f424564b6ba1 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:33.016099 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-21d03322-cb5f-46ad-b392-f424564b6ba1 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:33.016884 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-21d03322-cb5f-46ad-b392-f424564b6ba1 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:33.017321 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-21d03322-cb5f-46ad-b392-f424564b6ba1 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:33.107755 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-21d03322-cb5f-46ad-b392-f424564b6ba1 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:33.116242 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-21d03322-cb5f-46ad-b392-f424564b6ba1 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1273 microversion: 2.1 time: 0.116544 Jun 07 22:03:33.140954 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 13/43] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:32 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1273 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:03:33.146555 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-8374eda6-caf4-4089-a4c5-7f70f3bd8557 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:33.147419 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-8374eda6-caf4-4089-a4c5-7f70f3bd8557 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 5704eeef-7ef8-4e6d-b39d-d672e9592836] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:33.236479 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-8374eda6-caf4-4089-a4c5-7f70f3bd8557 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:33.246546 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-8374eda6-caf4-4089-a4c5-7f70f3bd8557 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836" status: 200 len: 1242 microversion: 2.1 time: 0.104136 Jun 07 22:03:33.247149 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 14/44] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:33 2022] GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836 => generated 1242 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:03:33.594295 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-944647d7-4d67-4f55-b051-1beeaa672edf tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:33.594946 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-944647d7-4d67-4f55-b051-1beeaa672edf tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] [instance: b6a3577d-4aaf-4947-95c1-873076371ae7] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:33.611421 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-944647d7-4d67-4f55-b051-1beeaa672edf tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:33.611886 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-944647d7-4d67-4f55-b051-1beeaa672edf tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:33.612662 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-944647d7-4d67-4f55-b051-1beeaa672edf tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:33.613101 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-944647d7-4d67-4f55-b051-1beeaa672edf tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:33.715409 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.virt.hardware [None req-926b815f-445d-4422-ae71-620d6d900198 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Flavor limits 0:0:0 {{(pid=117971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 22:03:33.720017 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.virt.hardware [None req-926b815f-445d-4422-ae71-620d6d900198 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Image limits 0:0:0 {{(pid=117971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 22:03:33.720506 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.virt.hardware [None req-926b815f-445d-4422-ae71-620d6d900198 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Flavor pref 0:0:0 {{(pid=117971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 22:03:33.720954 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.virt.hardware [None req-926b815f-445d-4422-ae71-620d6d900198 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Image pref 0:0:0 {{(pid=117971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 22:03:33.723179 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.virt.hardware [None req-926b815f-445d-4422-ae71-620d6d900198 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 22:03:33.733090 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_cell0:SELECT=2 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:03:33.771870 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-926b815f-445d-4422-ae71-620d6d900198 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:33.772824 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-926b815f-445d-4422-ae71-620d6d900198 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:33.774011 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-926b815f-445d-4422-ae71-620d6d900198 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:33.774681 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-926b815f-445d-4422-ae71-620d6d900198 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:33.809593 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-944647d7-4d67-4f55-b051-1beeaa672edf tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1378a898f9534635857e5958d32f00c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8d5b4fdf9a48a296359e167017123f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:33.820376 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.quota [None req-926b815f-445d-4422-ae71-620d6d900198 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Getting quotas for project d32f58b7303541388483ca4b881a552e. Resources: {'cores', 'ram', 'instances'} {{(pid=117971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 22:03:33.820642 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-944647d7-4d67-4f55-b051-1beeaa672edf tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] 10.222.0.13 "GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7" status: 200 len: 1314 microversion: 2.1 time: 0.229755 Jun 07 22:03:33.822464 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 15/45] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:33 2022] GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7 => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:03:33.828652 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.quota [None req-926b815f-445d-4422-ae71-620d6d900198 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Getting quotas for user 0e68eff6a08d4193b3167d47f4e1f97c and project d32f58b7303541388483ca4b881a552e. Resources: {'cores', 'ram', 'instances'} {{(pid=117971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 22:03:33.842237 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-926b815f-445d-4422-ae71-620d6d900198 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Going to run 1 instances... {{(pid=117971) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 22:03:33.845332 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-926b815f-445d-4422-ae71-620d6d900198 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='87e2e140-6de8-4531-9681-d0a3e069622d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 22:03:33.941607 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-926b815f-445d-4422-ae71-620d6d900198 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.363641 Jun 07 22:03:33.954771 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-b2d7318c-b8ae-49b0-a479-47ee74a77928 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:33.955481 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-b2d7318c-b8ae-49b0-a479-47ee74a77928 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:33.960322 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 31/46] 10.222.0.13 () {60 vars in 1146 bytes} [Tue Jun 7 22:03:32 2022] POST /compute/v2.1/servers => generated 401 bytes in 1383 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 22:03:34.026627 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-b2d7318c-b8ae-49b0-a479-47ee74a77928 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:34.042332 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-b2d7318c-b8ae-49b0-a479-47ee74a77928 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1235 microversion: 2.1 time: 0.090921 Jun 07 22:03:34.043639 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 16/47] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:33 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1235 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:03:34.149526 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-43321b70-8707-46ce-aa46-905a1ef048e9 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:34.150482 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-43321b70-8707-46ce-aa46-905a1ef048e9 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:34.160869 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-43321b70-8707-46ce-aa46-905a1ef048e9 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:34.161596 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-43321b70-8707-46ce-aa46-905a1ef048e9 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:34.162969 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-43321b70-8707-46ce-aa46-905a1ef048e9 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:34.163913 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-43321b70-8707-46ce-aa46-905a1ef048e9 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:34.238292 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-43321b70-8707-46ce-aa46-905a1ef048e9 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:34.246593 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-43321b70-8707-46ce-aa46-905a1ef048e9 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1273 microversion: 2.1 time: 0.101978 Jun 07 22:03:34.247534 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 32/48] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:34 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1273 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:03:34.267431 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-f4c72f1a-92b7-4232-8538-2ff445cc70ed tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:34.267989 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-f4c72f1a-92b7-4232-8538-2ff445cc70ed tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 5704eeef-7ef8-4e6d-b39d-d672e9592836] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:34.274220 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f4c72f1a-92b7-4232-8538-2ff445cc70ed tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:34.274670 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f4c72f1a-92b7-4232-8538-2ff445cc70ed tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:34.275511 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f4c72f1a-92b7-4232-8538-2ff445cc70ed tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:34.275945 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f4c72f1a-92b7-4232-8538-2ff445cc70ed tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:34.340787 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-f4c72f1a-92b7-4232-8538-2ff445cc70ed tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:34.349445 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-f4c72f1a-92b7-4232-8538-2ff445cc70ed tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836" status: 200 len: 1246 microversion: 2.1 time: 0.086415 Jun 07 22:03:34.350075 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 17/49] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:34 2022] GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836 => generated 1246 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:03:34.838387 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-42cf49b7-bfd5-4b58-b01f-c47da6c57d9f tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:34.839680 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-42cf49b7-bfd5-4b58-b01f-c47da6c57d9f tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] [instance: b6a3577d-4aaf-4947-95c1-873076371ae7] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:34.845612 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-42cf49b7-bfd5-4b58-b01f-c47da6c57d9f tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:34.846049 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-42cf49b7-bfd5-4b58-b01f-c47da6c57d9f tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:34.846820 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-42cf49b7-bfd5-4b58-b01f-c47da6c57d9f tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:34.847250 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-42cf49b7-bfd5-4b58-b01f-c47da6c57d9f tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:34.978172 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-42cf49b7-bfd5-4b58-b01f-c47da6c57d9f tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1378a898f9534635857e5958d32f00c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8d5b4fdf9a48a296359e167017123f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:34.986372 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-42cf49b7-bfd5-4b58-b01f-c47da6c57d9f tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] 10.222.0.13 "GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7" status: 200 len: 1314 microversion: 2.1 time: 0.151834 Jun 07 22:03:34.986942 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 33/50] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:34 2022] GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:03:35.061468 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-2b2a1518-b454-44dc-8683-99e06325a4dd tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:35.062366 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-2b2a1518-b454-44dc-8683-99e06325a4dd tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:35.068793 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-2b2a1518-b454-44dc-8683-99e06325a4dd tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:35.069239 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-2b2a1518-b454-44dc-8683-99e06325a4dd tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:35.069987 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-2b2a1518-b454-44dc-8683-99e06325a4dd tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:35.070418 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-2b2a1518-b454-44dc-8683-99e06325a4dd tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:35.137374 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-2b2a1518-b454-44dc-8683-99e06325a4dd tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:35.144813 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-2b2a1518-b454-44dc-8683-99e06325a4dd tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1239 microversion: 2.1 time: 0.088641 Jun 07 22:03:35.145374 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 18/51] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:35 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1239 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:03:35.263728 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-2a5e1f4f-8cde-4315-a11c-25dd3efdd6bc tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:35.264360 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-2a5e1f4f-8cde-4315-a11c-25dd3efdd6bc tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:35.270347 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-2a5e1f4f-8cde-4315-a11c-25dd3efdd6bc tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:35.270854 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-2a5e1f4f-8cde-4315-a11c-25dd3efdd6bc tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:35.271623 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-2a5e1f4f-8cde-4315-a11c-25dd3efdd6bc tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:35.272147 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-2a5e1f4f-8cde-4315-a11c-25dd3efdd6bc tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:35.342174 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-2a5e1f4f-8cde-4315-a11c-25dd3efdd6bc tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:35.349762 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-2a5e1f4f-8cde-4315-a11c-25dd3efdd6bc tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1273 microversion: 2.1 time: 0.090591 Jun 07 22:03:35.350553 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 34/52] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:35 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1273 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:03:35.367700 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-2d06d518-8b6b-41e9-b227-36c24f619ca8 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:35.368428 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-2d06d518-8b6b-41e9-b227-36c24f619ca8 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 5704eeef-7ef8-4e6d-b39d-d672e9592836] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:35.374693 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-2d06d518-8b6b-41e9-b227-36c24f619ca8 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:35.375251 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-2d06d518-8b6b-41e9-b227-36c24f619ca8 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:35.376094 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-2d06d518-8b6b-41e9-b227-36c24f619ca8 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:35.376542 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-2d06d518-8b6b-41e9-b227-36c24f619ca8 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:35.441212 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-2d06d518-8b6b-41e9-b227-36c24f619ca8 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:35.450567 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-2d06d518-8b6b-41e9-b227-36c24f619ca8 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836" status: 200 len: 1246 microversion: 2.1 time: 0.086802 Jun 07 22:03:35.451140 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 19/53] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:35 2022] GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836 => generated 1246 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:03:36.005694 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-9c66a499-6851-4f14-b7c1-e370fbf7f264 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:36.008211 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-9c66a499-6851-4f14-b7c1-e370fbf7f264 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] [instance: b6a3577d-4aaf-4947-95c1-873076371ae7] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:36.025701 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-9c66a499-6851-4f14-b7c1-e370fbf7f264 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:36.026020 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-9c66a499-6851-4f14-b7c1-e370fbf7f264 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:36.028108 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-9c66a499-6851-4f14-b7c1-e370fbf7f264 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:36.030501 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-9c66a499-6851-4f14-b7c1-e370fbf7f264 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:36.065404 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_cell1:SELECT=100 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:03:36.162362 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-3e0b0f06-393f-41cd-8719-4128638249cd tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:36.163174 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-3e0b0f06-393f-41cd-8719-4128638249cd tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:36.177252 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-3e0b0f06-393f-41cd-8719-4128638249cd tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:36.179425 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-3e0b0f06-393f-41cd-8719-4128638249cd tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:36.186755 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-3e0b0f06-393f-41cd-8719-4128638249cd tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:36.187667 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-3e0b0f06-393f-41cd-8719-4128638249cd tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:36.291899 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-9c66a499-6851-4f14-b7c1-e370fbf7f264 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1378a898f9534635857e5958d32f00c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8d5b4fdf9a48a296359e167017123f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:36.300586 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-9c66a499-6851-4f14-b7c1-e370fbf7f264 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] 10.222.0.13 "GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7" status: 200 len: 1314 microversion: 2.1 time: 0.301031 Jun 07 22:03:36.302469 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 35/54] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:35 2022] GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7 => generated 1314 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:03:36.341713 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-3e0b0f06-393f-41cd-8719-4128638249cd tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:36.354854 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-3e0b0f06-393f-41cd-8719-4128638249cd tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1239 microversion: 2.1 time: 0.195848 Jun 07 22:03:36.356388 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 20/55] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:36 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1239 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:03:36.372548 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-91c37868-d13d-495b-aab7-533c5d7eb6dd tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:36.373838 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-91c37868-d13d-495b-aab7-533c5d7eb6dd tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:36.381022 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-91c37868-d13d-495b-aab7-533c5d7eb6dd tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:36.381480 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-91c37868-d13d-495b-aab7-533c5d7eb6dd tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:36.382284 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-91c37868-d13d-495b-aab7-533c5d7eb6dd tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:36.382721 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-91c37868-d13d-495b-aab7-533c5d7eb6dd tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:36.471359 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-3538946c-8dbd-481d-bb81-6978f2fab034 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:36.472836 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-3538946c-8dbd-481d-bb81-6978f2fab034 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 5704eeef-7ef8-4e6d-b39d-d672e9592836] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:36.484894 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-91c37868-d13d-495b-aab7-533c5d7eb6dd tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:36.494685 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-91c37868-d13d-495b-aab7-533c5d7eb6dd tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1281 microversion: 2.1 time: 0.132220 Jun 07 22:03:36.495928 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 36/56] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:36 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1281 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:03:36.498626 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-3538946c-8dbd-481d-bb81-6978f2fab034 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:36.499587 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-3538946c-8dbd-481d-bb81-6978f2fab034 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:36.500605 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-3538946c-8dbd-481d-bb81-6978f2fab034 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:36.501220 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-3538946c-8dbd-481d-bb81-6978f2fab034 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:36.619817 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-3538946c-8dbd-481d-bb81-6978f2fab034 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:36.628466 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-3538946c-8dbd-481d-bb81-6978f2fab034 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836" status: 200 len: 1246 microversion: 2.1 time: 0.164150 Jun 07 22:03:36.629502 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 21/57] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:36 2022] GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836 => generated 1246 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:03:37.318979 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-966a955f-88ee-4ffb-9423-92c1b781334e tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:37.320906 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-966a955f-88ee-4ffb-9423-92c1b781334e tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] [instance: b6a3577d-4aaf-4947-95c1-873076371ae7] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:37.328431 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-966a955f-88ee-4ffb-9423-92c1b781334e tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:37.329120 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-966a955f-88ee-4ffb-9423-92c1b781334e tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:37.330068 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-966a955f-88ee-4ffb-9423-92c1b781334e tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:37.330654 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-966a955f-88ee-4ffb-9423-92c1b781334e tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:37.373875 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-315c5e85-d9e8-4e3d-b975-999d473577bb tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:37.374649 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-315c5e85-d9e8-4e3d-b975-999d473577bb tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:37.380828 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-315c5e85-d9e8-4e3d-b975-999d473577bb tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:37.381273 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-315c5e85-d9e8-4e3d-b975-999d473577bb tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:37.382026 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-315c5e85-d9e8-4e3d-b975-999d473577bb tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:37.382511 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-315c5e85-d9e8-4e3d-b975-999d473577bb tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:37.457405 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-315c5e85-d9e8-4e3d-b975-999d473577bb tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:37.465255 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-315c5e85-d9e8-4e3d-b975-999d473577bb tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1239 microversion: 2.1 time: 0.095713 Jun 07 22:03:37.465842 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 22/58] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:37 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1239 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:03:37.512883 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-acd6fb1b-3b24-4f6a-ad68-c252c3d645e5 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:37.513486 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-acd6fb1b-3b24-4f6a-ad68-c252c3d645e5 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:37.519451 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-acd6fb1b-3b24-4f6a-ad68-c252c3d645e5 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:37.519895 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-acd6fb1b-3b24-4f6a-ad68-c252c3d645e5 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:37.520677 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-acd6fb1b-3b24-4f6a-ad68-c252c3d645e5 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:37.521112 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-acd6fb1b-3b24-4f6a-ad68-c252c3d645e5 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:37.527384 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-966a955f-88ee-4ffb-9423-92c1b781334e tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1378a898f9534635857e5958d32f00c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8d5b4fdf9a48a296359e167017123f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:37.536225 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-966a955f-88ee-4ffb-9423-92c1b781334e tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] 10.222.0.13 "GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7" status: 200 len: 1314 microversion: 2.1 time: 0.221301 Jun 07 22:03:37.537293 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 37/59] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:37 2022] GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:03:37.595569 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-acd6fb1b-3b24-4f6a-ad68-c252c3d645e5 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:37.603933 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-acd6fb1b-3b24-4f6a-ad68-c252c3d645e5 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1281 microversion: 2.1 time: 0.094673 Jun 07 22:03:37.613234 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 23/60] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:37 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1281 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:03:37.646793 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-ad55e6b6-2e2b-4042-929e-7c0064e757a2 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:37.647622 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-ad55e6b6-2e2b-4042-929e-7c0064e757a2 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 5704eeef-7ef8-4e6d-b39d-d672e9592836] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:37.655972 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ad55e6b6-2e2b-4042-929e-7c0064e757a2 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:37.656418 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ad55e6b6-2e2b-4042-929e-7c0064e757a2 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:37.657181 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ad55e6b6-2e2b-4042-929e-7c0064e757a2 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:37.657621 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ad55e6b6-2e2b-4042-929e-7c0064e757a2 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:37.732433 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-ad55e6b6-2e2b-4042-929e-7c0064e757a2 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:37.741787 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-ad55e6b6-2e2b-4042-929e-7c0064e757a2 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836" status: 200 len: 1246 microversion: 2.1 time: 0.099739 Jun 07 22:03:37.742347 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 38/61] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:37 2022] GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836 => generated 1246 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:03:38.483364 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-c76feac1-35e3-4190-a700-a080d6d5827a tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:38.484061 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-c76feac1-35e3-4190-a700-a080d6d5827a tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:38.491657 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c76feac1-35e3-4190-a700-a080d6d5827a tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:38.492682 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c76feac1-35e3-4190-a700-a080d6d5827a tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:38.494273 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c76feac1-35e3-4190-a700-a080d6d5827a tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:38.494868 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c76feac1-35e3-4190-a700-a080d6d5827a tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:38.555256 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-b68ef01f-6934-4621-9214-426abc0ec73e tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:38.556572 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-b68ef01f-6934-4621-9214-426abc0ec73e tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] [instance: b6a3577d-4aaf-4947-95c1-873076371ae7] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:38.564459 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b68ef01f-6934-4621-9214-426abc0ec73e tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:38.565219 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b68ef01f-6934-4621-9214-426abc0ec73e tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:38.566354 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b68ef01f-6934-4621-9214-426abc0ec73e tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:38.566987 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b68ef01f-6934-4621-9214-426abc0ec73e tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:38.594623 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-c76feac1-35e3-4190-a700-a080d6d5827a tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:38.613589 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-c76feac1-35e3-4190-a700-a080d6d5827a tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1239 microversion: 2.1 time: 0.135166 Jun 07 22:03:38.626574 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 24/62] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:38 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1239 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:03:38.642527 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-50ed1c06-5c7d-4850-b87d-d789872b6d5a tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:38.643462 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-50ed1c06-5c7d-4850-b87d-d789872b6d5a tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:38.650821 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-50ed1c06-5c7d-4850-b87d-d789872b6d5a tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:38.652205 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-50ed1c06-5c7d-4850-b87d-d789872b6d5a tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:38.653413 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-50ed1c06-5c7d-4850-b87d-d789872b6d5a tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:38.654055 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-50ed1c06-5c7d-4850-b87d-d789872b6d5a tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:38.748857 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-50ed1c06-5c7d-4850-b87d-d789872b6d5a tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:38.758891 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-50ed1c06-5c7d-4850-b87d-d789872b6d5a tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1281 microversion: 2.1 time: 0.122108 Jun 07 22:03:38.759720 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 25/63] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:38 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1281 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:03:38.766458 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-2402f495-d06e-41db-952c-aff7530edfb2 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:38.767801 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-2402f495-d06e-41db-952c-aff7530edfb2 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 5704eeef-7ef8-4e6d-b39d-d672e9592836] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:38.777111 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-2402f495-d06e-41db-952c-aff7530edfb2 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:38.778511 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-2402f495-d06e-41db-952c-aff7530edfb2 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:38.779947 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-2402f495-d06e-41db-952c-aff7530edfb2 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:38.780639 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-2402f495-d06e-41db-952c-aff7530edfb2 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:38.944102 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-2402f495-d06e-41db-952c-aff7530edfb2 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:38.955292 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-2402f495-d06e-41db-952c-aff7530edfb2 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836" status: 200 len: 1246 microversion: 2.1 time: 0.193188 Jun 07 22:03:38.957868 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 26/64] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:38 2022] GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836 => generated 1246 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:03:39.153631 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-b68ef01f-6934-4621-9214-426abc0ec73e tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1378a898f9534635857e5958d32f00c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8d5b4fdf9a48a296359e167017123f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:39.164709 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-b68ef01f-6934-4621-9214-426abc0ec73e tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] 10.222.0.13 "GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7" status: 200 len: 1314 microversion: 2.1 time: 0.614360 Jun 07 22:03:39.170565 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 39/65] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:38 2022] GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7 => generated 1314 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:03:39.632264 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-31d05653-fa44-48ba-9d31-a1e66a33886b tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:39.632952 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-31d05653-fa44-48ba-9d31-a1e66a33886b tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:39.646555 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-31d05653-fa44-48ba-9d31-a1e66a33886b tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:39.647083 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-31d05653-fa44-48ba-9d31-a1e66a33886b tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:39.647895 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-31d05653-fa44-48ba-9d31-a1e66a33886b tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:39.648337 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-31d05653-fa44-48ba-9d31-a1e66a33886b tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:39.761466 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-31d05653-fa44-48ba-9d31-a1e66a33886b tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:39.777527 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-4a51f2d1-6f7a-412f-8384-86b3e893b304 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:39.778169 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-4a51f2d1-6f7a-412f-8384-86b3e893b304 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:39.782842 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-31d05653-fa44-48ba-9d31-a1e66a33886b tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1287 microversion: 2.1 time: 0.154585 Jun 07 22:03:39.786635 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 27/66] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:39 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1287 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:03:39.787965 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-4a51f2d1-6f7a-412f-8384-86b3e893b304 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:39.788702 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-4a51f2d1-6f7a-412f-8384-86b3e893b304 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:39.789767 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-4a51f2d1-6f7a-412f-8384-86b3e893b304 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:39.790196 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-4a51f2d1-6f7a-412f-8384-86b3e893b304 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:39.933964 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-4a51f2d1-6f7a-412f-8384-86b3e893b304 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:39.941831 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-4a51f2d1-6f7a-412f-8384-86b3e893b304 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1279 microversion: 2.1 time: 0.169106 Jun 07 22:03:39.942407 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 40/67] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:39 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1279 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:03:39.975012 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-eed5736d-a772-4239-80f1-5c4834124d6b tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:39.975898 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-eed5736d-a772-4239-80f1-5c4834124d6b tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 5704eeef-7ef8-4e6d-b39d-d672e9592836] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:39.984762 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-eed5736d-a772-4239-80f1-5c4834124d6b tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:39.990997 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-eed5736d-a772-4239-80f1-5c4834124d6b tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:39.991852 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-eed5736d-a772-4239-80f1-5c4834124d6b tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:39.992287 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-eed5736d-a772-4239-80f1-5c4834124d6b tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:40.084216 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-eed5736d-a772-4239-80f1-5c4834124d6b tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:40.105456 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-eed5736d-a772-4239-80f1-5c4834124d6b tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836" status: 200 len: 1294 microversion: 2.1 time: 0.132578 Jun 07 22:03:40.106711 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 28/68] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:39 2022] GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836 => generated 1294 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:03:40.182942 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-089bc01c-4e13-4786-8dc5-739819b51ec7 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:40.183789 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-089bc01c-4e13-4786-8dc5-739819b51ec7 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] [instance: b6a3577d-4aaf-4947-95c1-873076371ae7] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:40.196116 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-089bc01c-4e13-4786-8dc5-739819b51ec7 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:40.197200 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-089bc01c-4e13-4786-8dc5-739819b51ec7 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:40.200121 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-089bc01c-4e13-4786-8dc5-739819b51ec7 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:40.200585 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-089bc01c-4e13-4786-8dc5-739819b51ec7 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:40.443150 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-089bc01c-4e13-4786-8dc5-739819b51ec7 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1378a898f9534635857e5958d32f00c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8d5b4fdf9a48a296359e167017123f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:40.443998 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-089bc01c-4e13-4786-8dc5-739819b51ec7 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] 10.222.0.13 "GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7" status: 200 len: 1314 microversion: 2.1 time: 0.265682 Jun 07 22:03:40.447887 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 41/69] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:40 2022] GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7 => generated 1314 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:03:40.804065 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-0bd2fd52-ce83-4398-b470-9d82e59554eb tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:40.806202 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-0bd2fd52-ce83-4398-b470-9d82e59554eb tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:40.815870 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0bd2fd52-ce83-4398-b470-9d82e59554eb tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:40.816717 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0bd2fd52-ce83-4398-b470-9d82e59554eb tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:40.817627 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0bd2fd52-ce83-4398-b470-9d82e59554eb tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:40.818201 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0bd2fd52-ce83-4398-b470-9d82e59554eb tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:40.928547 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-0bd2fd52-ce83-4398-b470-9d82e59554eb tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:40.939548 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-0bd2fd52-ce83-4398-b470-9d82e59554eb tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1287 microversion: 2.1 time: 0.139224 Jun 07 22:03:40.940317 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 29/70] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:40 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1287 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:03:40.960061 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-df1c1138-276d-4bd2-921a-5fab797f84ef tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:40.961200 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-df1c1138-276d-4bd2-921a-5fab797f84ef tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:40.970071 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-df1c1138-276d-4bd2-921a-5fab797f84ef tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:40.970725 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-df1c1138-276d-4bd2-921a-5fab797f84ef tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:40.971677 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-df1c1138-276d-4bd2-921a-5fab797f84ef tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:40.972265 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-df1c1138-276d-4bd2-921a-5fab797f84ef tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:41.069909 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-df1c1138-276d-4bd2-921a-5fab797f84ef tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:41.080106 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-df1c1138-276d-4bd2-921a-5fab797f84ef tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1279 microversion: 2.1 time: 0.123267 Jun 07 22:03:41.082496 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 42/71] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:40 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1279 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:03:41.124684 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-77d9a00c-06f3-4397-b41a-e86344fdbd3b tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:41.125294 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-77d9a00c-06f3-4397-b41a-e86344fdbd3b tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 5704eeef-7ef8-4e6d-b39d-d672e9592836] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:41.132568 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-77d9a00c-06f3-4397-b41a-e86344fdbd3b tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:41.133058 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-77d9a00c-06f3-4397-b41a-e86344fdbd3b tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:41.134210 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-77d9a00c-06f3-4397-b41a-e86344fdbd3b tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:41.134698 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-77d9a00c-06f3-4397-b41a-e86344fdbd3b tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:41.224033 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-77d9a00c-06f3-4397-b41a-e86344fdbd3b tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:41.238132 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-77d9a00c-06f3-4397-b41a-e86344fdbd3b tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836" status: 200 len: 1294 microversion: 2.1 time: 0.118016 Jun 07 22:03:41.238917 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 30/72] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:41 2022] GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836 => generated 1294 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:03:41.466575 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-1c7da0fd-850e-4c3d-a22e-dc3adac5e36b tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:41.468403 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-1c7da0fd-850e-4c3d-a22e-dc3adac5e36b tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] [instance: b6a3577d-4aaf-4947-95c1-873076371ae7] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:41.476529 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-1c7da0fd-850e-4c3d-a22e-dc3adac5e36b tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:41.477484 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-1c7da0fd-850e-4c3d-a22e-dc3adac5e36b tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:41.478509 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-1c7da0fd-850e-4c3d-a22e-dc3adac5e36b tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:41.479997 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-1c7da0fd-850e-4c3d-a22e-dc3adac5e36b tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:41.699808 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-1c7da0fd-850e-4c3d-a22e-dc3adac5e36b tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1378a898f9534635857e5958d32f00c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8d5b4fdf9a48a296359e167017123f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:41.716687 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-1c7da0fd-850e-4c3d-a22e-dc3adac5e36b tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] 10.222.0.13 "GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7" status: 200 len: 1314 microversion: 2.1 time: 0.257295 Jun 07 22:03:41.722193 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 43/73] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:41 2022] GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7 => generated 1314 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:03:41.962332 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-f359a861-5817-4247-999a-768a103361c1 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:41.964351 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-f359a861-5817-4247-999a-768a103361c1 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:41.975441 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f359a861-5817-4247-999a-768a103361c1 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:41.976476 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f359a861-5817-4247-999a-768a103361c1 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:41.977467 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f359a861-5817-4247-999a-768a103361c1 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:41.978054 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f359a861-5817-4247-999a-768a103361c1 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:41.997174 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_cell1:SELECT=100 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:03:42.061607 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-f359a861-5817-4247-999a-768a103361c1 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:42.069711 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-f359a861-5817-4247-999a-768a103361c1 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1287 microversion: 2.1 time: 0.115835 Jun 07 22:03:42.071019 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 31/74] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:41 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1287 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:03:42.099072 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-449852bf-2166-4804-8b52-b4c68e208c11 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:42.099710 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-449852bf-2166-4804-8b52-b4c68e208c11 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:42.107753 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-449852bf-2166-4804-8b52-b4c68e208c11 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:42.108517 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-449852bf-2166-4804-8b52-b4c68e208c11 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:42.109835 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-449852bf-2166-4804-8b52-b4c68e208c11 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:42.110803 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-449852bf-2166-4804-8b52-b4c68e208c11 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:42.256302 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-f9afbdfe-1d27-4fbd-ae74-2caf6b64c132 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:42.256800 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-f9afbdfe-1d27-4fbd-ae74-2caf6b64c132 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 5704eeef-7ef8-4e6d-b39d-d672e9592836] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:42.270376 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f9afbdfe-1d27-4fbd-ae74-2caf6b64c132 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:42.270827 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f9afbdfe-1d27-4fbd-ae74-2caf6b64c132 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:42.271637 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f9afbdfe-1d27-4fbd-ae74-2caf6b64c132 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:42.272067 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f9afbdfe-1d27-4fbd-ae74-2caf6b64c132 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:42.284668 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-449852bf-2166-4804-8b52-b4c68e208c11 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:42.296485 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-449852bf-2166-4804-8b52-b4c68e208c11 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1321 microversion: 2.1 time: 0.201150 Jun 07 22:03:42.298798 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 44/75] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:42 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1321 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:03:42.353421 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-f9afbdfe-1d27-4fbd-ae74-2caf6b64c132 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:42.362497 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-f9afbdfe-1d27-4fbd-ae74-2caf6b64c132 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836" status: 200 len: 1294 microversion: 2.1 time: 0.110529 Jun 07 22:03:42.363534 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 32/76] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:42 2022] GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836 => generated 1294 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:03:42.738876 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-93175a68-5a09-47dc-9b32-3e6243b8124e tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:42.739519 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-93175a68-5a09-47dc-9b32-3e6243b8124e tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] [instance: b6a3577d-4aaf-4947-95c1-873076371ae7] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:42.756472 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-93175a68-5a09-47dc-9b32-3e6243b8124e tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:42.757193 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-93175a68-5a09-47dc-9b32-3e6243b8124e tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:42.757976 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-93175a68-5a09-47dc-9b32-3e6243b8124e tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:42.758407 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-93175a68-5a09-47dc-9b32-3e6243b8124e tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:42.905983 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-93175a68-5a09-47dc-9b32-3e6243b8124e tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1378a898f9534635857e5958d32f00c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8d5b4fdf9a48a296359e167017123f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:42.913449 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-93175a68-5a09-47dc-9b32-3e6243b8124e tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] 10.222.0.13 "GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7" status: 200 len: 1314 microversion: 2.1 time: 0.178619 Jun 07 22:03:42.914068 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 45/77] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:42 2022] GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:03:43.087204 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-823d33c2-4441-43d1-a700-905ccd5d1570 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:43.087992 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-823d33c2-4441-43d1-a700-905ccd5d1570 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:43.090201 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_cell0:SELECT=1 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:03:43.095722 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-823d33c2-4441-43d1-a700-905ccd5d1570 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:43.096174 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-823d33c2-4441-43d1-a700-905ccd5d1570 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:43.097011 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-823d33c2-4441-43d1-a700-905ccd5d1570 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:43.097447 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-823d33c2-4441-43d1-a700-905ccd5d1570 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:43.161679 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-823d33c2-4441-43d1-a700-905ccd5d1570 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:43.169332 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-823d33c2-4441-43d1-a700-905ccd5d1570 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1287 microversion: 2.1 time: 0.086248 Jun 07 22:03:43.169917 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 33/78] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:43 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1287 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:03:43.313100 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-b66c0299-ebe5-4f54-a648-bd705c50aa21 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:43.313711 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-b66c0299-ebe5-4f54-a648-bd705c50aa21 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:43.319831 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b66c0299-ebe5-4f54-a648-bd705c50aa21 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:43.320344 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b66c0299-ebe5-4f54-a648-bd705c50aa21 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:43.321159 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b66c0299-ebe5-4f54-a648-bd705c50aa21 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:43.321659 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b66c0299-ebe5-4f54-a648-bd705c50aa21 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:43.380152 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-9040cf56-ac48-4151-b7b1-55d0f632d97b tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:43.380790 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-9040cf56-ac48-4151-b7b1-55d0f632d97b tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 5704eeef-7ef8-4e6d-b39d-d672e9592836] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:43.388682 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-9040cf56-ac48-4151-b7b1-55d0f632d97b tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:43.390706 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-9040cf56-ac48-4151-b7b1-55d0f632d97b tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:43.391531 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-9040cf56-ac48-4151-b7b1-55d0f632d97b tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:43.391971 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-9040cf56-ac48-4151-b7b1-55d0f632d97b tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:43.462660 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-9040cf56-ac48-4151-b7b1-55d0f632d97b tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:43.468029 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-b66c0299-ebe5-4f54-a648-bd705c50aa21 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:43.472405 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-9040cf56-ac48-4151-b7b1-55d0f632d97b tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836" status: 200 len: 1294 microversion: 2.1 time: 0.096069 Jun 07 22:03:43.473486 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 34/79] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:43 2022] GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836 => generated 1294 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:03:43.476988 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-b66c0299-ebe5-4f54-a648-bd705c50aa21 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1321 microversion: 2.1 time: 0.167659 Jun 07 22:03:43.487863 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 46/80] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:43 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1321 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:03:43.930393 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-135295a6-f946-452d-9afe-27fc065cb991 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:43.931011 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-135295a6-f946-452d-9afe-27fc065cb991 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] [instance: b6a3577d-4aaf-4947-95c1-873076371ae7] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:43.950689 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-135295a6-f946-452d-9afe-27fc065cb991 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:43.951115 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-135295a6-f946-452d-9afe-27fc065cb991 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:43.951975 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-135295a6-f946-452d-9afe-27fc065cb991 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:43.952412 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-135295a6-f946-452d-9afe-27fc065cb991 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:44.031800 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_cell0:SELECT=9 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:03:44.189353 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-cdb59936-eec7-4c59-9440-e9929a2ff3fe tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:44.190385 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-cdb59936-eec7-4c59-9440-e9929a2ff3fe tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:44.196550 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_cell0:SELECT=2 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:03:44.197552 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_cell0:SELECT=8 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:03:44.200877 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-cdb59936-eec7-4c59-9440-e9929a2ff3fe tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:44.201573 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-cdb59936-eec7-4c59-9440-e9929a2ff3fe tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:44.202725 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-cdb59936-eec7-4c59-9440-e9929a2ff3fe tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:44.203391 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-cdb59936-eec7-4c59-9440-e9929a2ff3fe tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:44.287867 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-135295a6-f946-452d-9afe-27fc065cb991 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1378a898f9534635857e5958d32f00c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8d5b4fdf9a48a296359e167017123f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:44.296901 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-135295a6-f946-452d-9afe-27fc065cb991 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] 10.222.0.13 "GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7" status: 200 len: 1314 microversion: 2.1 time: 0.370566 Jun 07 22:03:44.297833 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 35/81] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:43 2022] GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7 => generated 1314 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:03:44.439370 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-cdb59936-eec7-4c59-9440-e9929a2ff3fe tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:44.447307 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-cdb59936-eec7-4c59-9440-e9929a2ff3fe tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1293 microversion: 2.1 time: 0.264919 Jun 07 22:03:44.448081 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 47/82] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:44 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1293 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:03:44.492920 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-66e2e22c-ed3b-4767-b5ea-f6048d8506c0 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:44.493532 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-66e2e22c-ed3b-4767-b5ea-f6048d8506c0 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 5704eeef-7ef8-4e6d-b39d-d672e9592836] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:44.507086 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-66e2e22c-ed3b-4767-b5ea-f6048d8506c0 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:44.509114 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-66e2e22c-ed3b-4767-b5ea-f6048d8506c0 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:44.510187 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-66e2e22c-ed3b-4767-b5ea-f6048d8506c0 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:44.510873 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-17d07dc7-4501-4bdb-8c13-a143aedd2136 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:44.511629 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-66e2e22c-ed3b-4767-b5ea-f6048d8506c0 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:44.517066 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-17d07dc7-4501-4bdb-8c13-a143aedd2136 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:44.542341 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-17d07dc7-4501-4bdb-8c13-a143aedd2136 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:44.543023 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-17d07dc7-4501-4bdb-8c13-a143aedd2136 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:44.553349 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-17d07dc7-4501-4bdb-8c13-a143aedd2136 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:44.556004 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-17d07dc7-4501-4bdb-8c13-a143aedd2136 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:44.749274 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-66e2e22c-ed3b-4767-b5ea-f6048d8506c0 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:44.758414 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-66e2e22c-ed3b-4767-b5ea-f6048d8506c0 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836" status: 200 len: 1300 microversion: 2.1 time: 0.270784 Jun 07 22:03:44.762371 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 36/83] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:44 2022] GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836 => generated 1300 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:03:44.843780 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-17d07dc7-4501-4bdb-8c13-a143aedd2136 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:44.853232 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-17d07dc7-4501-4bdb-8c13-a143aedd2136 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1321 microversion: 2.1 time: 0.362908 Jun 07 22:03:44.854362 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 48/84] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:44 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1321 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:03:45.315222 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-620274a5-9e97-4c44-ba9a-3b4a62e06c3d tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:45.316066 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-620274a5-9e97-4c44-ba9a-3b4a62e06c3d tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] [instance: b6a3577d-4aaf-4947-95c1-873076371ae7] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:45.327509 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-620274a5-9e97-4c44-ba9a-3b4a62e06c3d tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:45.327963 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-620274a5-9e97-4c44-ba9a-3b4a62e06c3d tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:45.330401 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-620274a5-9e97-4c44-ba9a-3b4a62e06c3d tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:45.330850 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-620274a5-9e97-4c44-ba9a-3b4a62e06c3d tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:45.465523 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-7f9772ec-902d-4851-879c-7a40f18508bc tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:45.466130 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-7f9772ec-902d-4851-879c-7a40f18508bc tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:45.475351 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-7f9772ec-902d-4851-879c-7a40f18508bc tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:45.476048 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-7f9772ec-902d-4851-879c-7a40f18508bc tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:45.480091 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-7f9772ec-902d-4851-879c-7a40f18508bc tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:45.480721 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-7f9772ec-902d-4851-879c-7a40f18508bc tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:45.599458 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-7f9772ec-902d-4851-879c-7a40f18508bc tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:45.622298 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-7f9772ec-902d-4851-879c-7a40f18508bc tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1293 microversion: 2.1 time: 0.159553 Jun 07 22:03:45.622952 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 49/85] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:45 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1293 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:03:45.782297 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-5c594f6a-2cc1-4596-a5e2-19cbe1ccc54b tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:45.783019 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-5c594f6a-2cc1-4596-a5e2-19cbe1ccc54b tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 5704eeef-7ef8-4e6d-b39d-d672e9592836] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:45.800670 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-5c594f6a-2cc1-4596-a5e2-19cbe1ccc54b tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:45.801287 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-5c594f6a-2cc1-4596-a5e2-19cbe1ccc54b tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:45.802733 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-5c594f6a-2cc1-4596-a5e2-19cbe1ccc54b tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:45.803290 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-5c594f6a-2cc1-4596-a5e2-19cbe1ccc54b tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:45.846829 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-620274a5-9e97-4c44-ba9a-3b4a62e06c3d tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1378a898f9534635857e5958d32f00c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8d5b4fdf9a48a296359e167017123f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:45.871416 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-620274a5-9e97-4c44-ba9a-3b4a62e06c3d tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] 10.222.0.13 "GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7" status: 200 len: 1314 microversion: 2.1 time: 0.560529 Jun 07 22:03:45.872016 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 37/86] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:45 2022] GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7 => generated 1314 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:03:45.890627 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-a36d4eaa-e8ec-40a9-835e-e4ed21a93c0d tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:45.894231 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-a36d4eaa-e8ec-40a9-835e-e4ed21a93c0d tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:45.910817 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a36d4eaa-e8ec-40a9-835e-e4ed21a93c0d tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:45.911279 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a36d4eaa-e8ec-40a9-835e-e4ed21a93c0d tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:45.920225 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a36d4eaa-e8ec-40a9-835e-e4ed21a93c0d tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:45.921088 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a36d4eaa-e8ec-40a9-835e-e4ed21a93c0d tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:46.247372 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-5c594f6a-2cc1-4596-a5e2-19cbe1ccc54b tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:46.255301 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-5c594f6a-2cc1-4596-a5e2-19cbe1ccc54b tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836" status: 200 len: 1300 microversion: 2.1 time: 0.479732 Jun 07 22:03:46.260807 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 50/87] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:45 2022] GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836 => generated 1300 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:03:46.267385 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [req-d3655025-0a44-419a-b5c5-a11f51d666c1 req-e1253e8f-137b-40c5-ba71-a37a665308d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92b3a56b-7d09-4772-b1e4-c75b3971f7a5", "tag": "94c4dc88-ce6e-456a-a929-9e88a1b3df7d"}]} {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:03:46.289749 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-d3655025-0a44-419a-b5c5-a11f51d666c1 req-e1253e8f-137b-40c5-ba71-a37a665308d6 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:46.290111 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-d3655025-0a44-419a-b5c5-a11f51d666c1 req-e1253e8f-137b-40c5-ba71-a37a665308d6 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:46.306732 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.compute.server_external_events [req-d3655025-0a44-419a-b5c5-a11f51d666c1 req-e1253e8f-137b-40c5-ba71-a37a665308d6 service nova] Creating event network-changed:94c4dc88-ce6e-456a-a929-9e88a1b3df7d for instance 92b3a56b-7d09-4772-b1e4-c75b3971f7a5 on hv-cinder-83552 Jun 07 22:03:46.327726 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [req-d3655025-0a44-419a-b5c5-a11f51d666c1 req-e1253e8f-137b-40c5-ba71-a37a665308d6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065477 Jun 07 22:03:46.329959 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 51/88] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:03:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:03:46.645984 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-c2dd9269-6938-4e7c-8a5c-b41259ceb231 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:46.647597 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-c2dd9269-6938-4e7c-8a5c-b41259ceb231 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:46.678822 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c2dd9269-6938-4e7c-8a5c-b41259ceb231 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:46.679595 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c2dd9269-6938-4e7c-8a5c-b41259ceb231 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:46.682815 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c2dd9269-6938-4e7c-8a5c-b41259ceb231 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:46.683461 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c2dd9269-6938-4e7c-8a5c-b41259ceb231 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:46.739785 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-a36d4eaa-e8ec-40a9-835e-e4ed21a93c0d tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:46.748628 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-a36d4eaa-e8ec-40a9-835e-e4ed21a93c0d tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1321 microversion: 2.1 time: 0.875557 Jun 07 22:03:46.752413 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 38/89] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:45 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1321 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:03:46.825113 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-c2dd9269-6938-4e7c-8a5c-b41259ceb231 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:46.833761 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_cell1:SELECT=100 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:03:46.844199 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-c2dd9269-6938-4e7c-8a5c-b41259ceb231 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1293 microversion: 2.1 time: 0.204878 Jun 07 22:03:46.847489 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 52/90] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:46 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1293 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:03:46.891461 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-4bc6de24-70c5-4d0e-a2bb-29b07aa22517 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:46.892892 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-4bc6de24-70c5-4d0e-a2bb-29b07aa22517 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] [instance: b6a3577d-4aaf-4947-95c1-873076371ae7] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:46.906973 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4bc6de24-70c5-4d0e-a2bb-29b07aa22517 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:46.911455 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4bc6de24-70c5-4d0e-a2bb-29b07aa22517 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:46.912612 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4bc6de24-70c5-4d0e-a2bb-29b07aa22517 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:46.914363 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4bc6de24-70c5-4d0e-a2bb-29b07aa22517 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:47.052729 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [req-eb15301b-d428-4309-9911-b17e561a9179 req-9508d6a4-90aa-4596-bb59-5138c6a40d8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73af9eba-632b-4035-a6ad-02f4fa11866a", "tag": "7d1a50e0-bf7e-4a2c-a985-08a1f47ed1d2"}]} {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:03:47.081784 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-eb15301b-d428-4309-9911-b17e561a9179 req-9508d6a4-90aa-4596-bb59-5138c6a40d8c service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:47.087644 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-eb15301b-d428-4309-9911-b17e561a9179 req-9508d6a4-90aa-4596-bb59-5138c6a40d8c service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:47.101769 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.compute.server_external_events [req-eb15301b-d428-4309-9911-b17e561a9179 req-9508d6a4-90aa-4596-bb59-5138c6a40d8c service nova] Creating event network-changed:7d1a50e0-bf7e-4a2c-a985-08a1f47ed1d2 for instance 73af9eba-632b-4035-a6ad-02f4fa11866a on hv-cinder-83552 Jun 07 22:03:47.111899 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [req-eb15301b-d428-4309-9911-b17e561a9179 req-9508d6a4-90aa-4596-bb59-5138c6a40d8c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.190574 Jun 07 22:03:47.113738 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 53/91] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:03:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 22:03:47.158579 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-4bc6de24-70c5-4d0e-a2bb-29b07aa22517 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1378a898f9534635857e5958d32f00c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8d5b4fdf9a48a296359e167017123f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:47.168993 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-4bc6de24-70c5-4d0e-a2bb-29b07aa22517 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] 10.222.0.13 "GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7" status: 200 len: 1314 microversion: 2.1 time: 0.281620 Jun 07 22:03:47.170151 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 39/92] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:46 2022] GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7 => generated 1314 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:03:47.279223 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-ba798715-fbe8-4bfe-aa8a-3d0737e3ec31 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:47.283655 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-ba798715-fbe8-4bfe-aa8a-3d0737e3ec31 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 5704eeef-7ef8-4e6d-b39d-d672e9592836] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:47.292006 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ba798715-fbe8-4bfe-aa8a-3d0737e3ec31 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:47.293021 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ba798715-fbe8-4bfe-aa8a-3d0737e3ec31 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:47.294461 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ba798715-fbe8-4bfe-aa8a-3d0737e3ec31 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:47.294905 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ba798715-fbe8-4bfe-aa8a-3d0737e3ec31 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:47.448578 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-ba798715-fbe8-4bfe-aa8a-3d0737e3ec31 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:47.456411 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-ba798715-fbe8-4bfe-aa8a-3d0737e3ec31 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836" status: 200 len: 1368 microversion: 2.1 time: 0.182808 Jun 07 22:03:47.457215 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 54/93] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:47 2022] GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836 => generated 1368 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:03:47.766203 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-2b486061-a97b-444c-8c38-7a63cc283f55 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:47.767452 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-2b486061-a97b-444c-8c38-7a63cc283f55 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:47.773739 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-2b486061-a97b-444c-8c38-7a63cc283f55 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:47.774193 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-2b486061-a97b-444c-8c38-7a63cc283f55 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:47.774956 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-2b486061-a97b-444c-8c38-7a63cc283f55 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:47.775414 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-2b486061-a97b-444c-8c38-7a63cc283f55 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:47.862061 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-beb0e1eb-f047-4814-b310-4c7d6f215181 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:47.863212 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-beb0e1eb-f047-4814-b310-4c7d6f215181 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:47.869575 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-beb0e1eb-f047-4814-b310-4c7d6f215181 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:47.870738 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-beb0e1eb-f047-4814-b310-4c7d6f215181 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:47.871538 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-beb0e1eb-f047-4814-b310-4c7d6f215181 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:47.871968 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-beb0e1eb-f047-4814-b310-4c7d6f215181 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:47.910465 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-2b486061-a97b-444c-8c38-7a63cc283f55 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:47.929810 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-2b486061-a97b-444c-8c38-7a63cc283f55 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1321 microversion: 2.1 time: 0.167315 Jun 07 22:03:47.930577 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 40/94] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:47 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1321 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:03:48.028796 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-beb0e1eb-f047-4814-b310-4c7d6f215181 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:48.037936 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-beb0e1eb-f047-4814-b310-4c7d6f215181 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1360 microversion: 2.1 time: 0.179620 Jun 07 22:03:48.049222 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 55/95] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:47 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1360 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:03:48.186603 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-61bbc468-cb15-440e-8759-e6f3a8ec5d83 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:48.187245 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-61bbc468-cb15-440e-8759-e6f3a8ec5d83 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] [instance: b6a3577d-4aaf-4947-95c1-873076371ae7] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:48.195134 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-61bbc468-cb15-440e-8759-e6f3a8ec5d83 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:48.195933 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-61bbc468-cb15-440e-8759-e6f3a8ec5d83 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:48.196991 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-61bbc468-cb15-440e-8759-e6f3a8ec5d83 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:48.197436 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-61bbc468-cb15-440e-8759-e6f3a8ec5d83 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:48.455118 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-61bbc468-cb15-440e-8759-e6f3a8ec5d83 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1378a898f9534635857e5958d32f00c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8d5b4fdf9a48a296359e167017123f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:48.462517 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-61bbc468-cb15-440e-8759-e6f3a8ec5d83 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] 10.222.0.13 "GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7" status: 200 len: 1314 microversion: 2.1 time: 0.280277 Jun 07 22:03:48.463600 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 41/96] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:48 2022] GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7 => generated 1314 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:03:48.473752 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-01ea1732-73c3-459d-a7a1-ab887408837c tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:48.474354 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-01ea1732-73c3-459d-a7a1-ab887408837c tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 5704eeef-7ef8-4e6d-b39d-d672e9592836] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:48.480638 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-01ea1732-73c3-459d-a7a1-ab887408837c tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:48.481073 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-01ea1732-73c3-459d-a7a1-ab887408837c tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:48.481821 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-01ea1732-73c3-459d-a7a1-ab887408837c tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:48.482248 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-01ea1732-73c3-459d-a7a1-ab887408837c tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:48.643101 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-01ea1732-73c3-459d-a7a1-ab887408837c tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:48.655200 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-01ea1732-73c3-459d-a7a1-ab887408837c tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836" status: 200 len: 1368 microversion: 2.1 time: 0.184942 Jun 07 22:03:48.655873 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 56/97] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:48 2022] GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836 => generated 1368 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:03:48.946297 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-c92073b7-f375-45cb-91dd-d5e48496da50 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:48.947003 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-c92073b7-f375-45cb-91dd-d5e48496da50 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:48.953111 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c92073b7-f375-45cb-91dd-d5e48496da50 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:48.953628 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c92073b7-f375-45cb-91dd-d5e48496da50 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:48.954449 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c92073b7-f375-45cb-91dd-d5e48496da50 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:48.954951 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c92073b7-f375-45cb-91dd-d5e48496da50 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:49.056400 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-b5e2825a-2bdd-456e-a448-a8971f6587ac tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:49.056925 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-b5e2825a-2bdd-456e-a448-a8971f6587ac tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:49.063291 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b5e2825a-2bdd-456e-a448-a8971f6587ac tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:49.064910 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b5e2825a-2bdd-456e-a448-a8971f6587ac tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:49.065690 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b5e2825a-2bdd-456e-a448-a8971f6587ac tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:49.066129 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b5e2825a-2bdd-456e-a448-a8971f6587ac tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:49.097857 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-c92073b7-f375-45cb-91dd-d5e48496da50 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:49.109225 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-c92073b7-f375-45cb-91dd-d5e48496da50 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1321 microversion: 2.1 time: 0.166710 Jun 07 22:03:49.110108 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 42/98] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:48 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:03:49.204017 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-b5e2825a-2bdd-456e-a448-a8971f6587ac tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:49.211443 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-b5e2825a-2bdd-456e-a448-a8971f6587ac tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1360 microversion: 2.1 time: 0.159158 Jun 07 22:03:49.212015 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 57/99] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:49 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1360 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:03:49.482231 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-6dbd0318-b066-40ba-adfc-59fd4bd9703b tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:49.482832 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-6dbd0318-b066-40ba-adfc-59fd4bd9703b tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] [instance: b6a3577d-4aaf-4947-95c1-873076371ae7] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:49.489160 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6dbd0318-b066-40ba-adfc-59fd4bd9703b tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:49.489601 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6dbd0318-b066-40ba-adfc-59fd4bd9703b tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:49.490349 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6dbd0318-b066-40ba-adfc-59fd4bd9703b tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:49.490773 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6dbd0318-b066-40ba-adfc-59fd4bd9703b tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:49.625523 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-6dbd0318-b066-40ba-adfc-59fd4bd9703b tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1378a898f9534635857e5958d32f00c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8d5b4fdf9a48a296359e167017123f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:49.633000 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-6dbd0318-b066-40ba-adfc-59fd4bd9703b tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] 10.222.0.13 "GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7" status: 200 len: 1314 microversion: 2.1 time: 0.155284 Jun 07 22:03:49.633572 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 43/100] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:49 2022] GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:03:49.671789 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-1626f862-6786-43bc-8943-d55367eb7a13 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:49.672390 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-1626f862-6786-43bc-8943-d55367eb7a13 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 5704eeef-7ef8-4e6d-b39d-d672e9592836] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:49.678328 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-1626f862-6786-43bc-8943-d55367eb7a13 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:49.678762 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-1626f862-6786-43bc-8943-d55367eb7a13 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:49.679536 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-1626f862-6786-43bc-8943-d55367eb7a13 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:49.679964 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-1626f862-6786-43bc-8943-d55367eb7a13 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:49.815296 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-1626f862-6786-43bc-8943-d55367eb7a13 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:49.823397 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-1626f862-6786-43bc-8943-d55367eb7a13 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836" status: 200 len: 1368 microversion: 2.1 time: 0.154755 Jun 07 22:03:49.823586 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 58/101] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:49 2022] GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836 => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:03:50.125655 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-d15a048c-77d0-463a-8189-2efbadc5e704 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:50.126360 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-d15a048c-77d0-463a-8189-2efbadc5e704 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:50.132513 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d15a048c-77d0-463a-8189-2efbadc5e704 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:50.133040 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d15a048c-77d0-463a-8189-2efbadc5e704 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:50.133866 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d15a048c-77d0-463a-8189-2efbadc5e704 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:50.134307 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d15a048c-77d0-463a-8189-2efbadc5e704 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:50.229821 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-5cb8133f-612b-4421-b382-6983fd1a6ec9 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:50.231480 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-5cb8133f-612b-4421-b382-6983fd1a6ec9 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:50.239308 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-5cb8133f-612b-4421-b382-6983fd1a6ec9 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:50.239779 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-5cb8133f-612b-4421-b382-6983fd1a6ec9 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:50.240684 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-5cb8133f-612b-4421-b382-6983fd1a6ec9 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:50.241280 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-5cb8133f-612b-4421-b382-6983fd1a6ec9 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:50.283396 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-d15a048c-77d0-463a-8189-2efbadc5e704 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:50.293539 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-d15a048c-77d0-463a-8189-2efbadc5e704 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1321 microversion: 2.1 time: 0.171669 Jun 07 22:03:50.294454 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 44/102] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:50 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1321 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:03:50.375371 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-5cb8133f-612b-4421-b382-6983fd1a6ec9 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:50.382662 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-5cb8133f-612b-4421-b382-6983fd1a6ec9 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1360 microversion: 2.1 time: 0.157762 Jun 07 22:03:50.383224 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 59/103] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:50 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1360 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:03:50.655828 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-4aaf9a98-fb4f-40d9-b06d-8b47163bea56 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:50.656458 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-4aaf9a98-fb4f-40d9-b06d-8b47163bea56 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] [instance: b6a3577d-4aaf-4947-95c1-873076371ae7] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:50.662675 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4aaf9a98-fb4f-40d9-b06d-8b47163bea56 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:50.663391 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4aaf9a98-fb4f-40d9-b06d-8b47163bea56 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:50.664344 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4aaf9a98-fb4f-40d9-b06d-8b47163bea56 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:50.664927 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4aaf9a98-fb4f-40d9-b06d-8b47163bea56 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:50.808474 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-4aaf9a98-fb4f-40d9-b06d-8b47163bea56 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1378a898f9534635857e5958d32f00c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8d5b4fdf9a48a296359e167017123f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:50.815808 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-4aaf9a98-fb4f-40d9-b06d-8b47163bea56 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] 10.222.0.13 "GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7" status: 200 len: 1314 microversion: 2.1 time: 0.165922 Jun 07 22:03:50.816370 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 45/104] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:50 2022] GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:03:50.839704 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-5b844fc6-f939-4c9c-b3e9-dcbe0bdba1e5 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:50.840327 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-5b844fc6-f939-4c9c-b3e9-dcbe0bdba1e5 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 5704eeef-7ef8-4e6d-b39d-d672e9592836] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:50.847450 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-5b844fc6-f939-4c9c-b3e9-dcbe0bdba1e5 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:50.847574 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-5b844fc6-f939-4c9c-b3e9-dcbe0bdba1e5 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:50.848434 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-5b844fc6-f939-4c9c-b3e9-dcbe0bdba1e5 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:50.848982 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-5b844fc6-f939-4c9c-b3e9-dcbe0bdba1e5 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:50.976751 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-5b844fc6-f939-4c9c-b3e9-dcbe0bdba1e5 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:50.984167 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-5b844fc6-f939-4c9c-b3e9-dcbe0bdba1e5 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836" status: 200 len: 1368 microversion: 2.1 time: 0.149266 Jun 07 22:03:50.984731 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 60/105] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:50 2022] GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836 => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:03:51.310292 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-25ba8ce6-0b10-4cc2-8e6c-4fe8a130980b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:51.310920 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-25ba8ce6-0b10-4cc2-8e6c-4fe8a130980b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:51.316930 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-25ba8ce6-0b10-4cc2-8e6c-4fe8a130980b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:51.317366 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-25ba8ce6-0b10-4cc2-8e6c-4fe8a130980b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:51.318108 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-25ba8ce6-0b10-4cc2-8e6c-4fe8a130980b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:51.318536 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-25ba8ce6-0b10-4cc2-8e6c-4fe8a130980b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:51.399169 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-6af8c848-797c-4f63-a383-24540fbdefad tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:51.399808 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-6af8c848-797c-4f63-a383-24540fbdefad tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:51.406187 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-6af8c848-797c-4f63-a383-24540fbdefad tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:51.406630 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-6af8c848-797c-4f63-a383-24540fbdefad tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:51.407459 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-6af8c848-797c-4f63-a383-24540fbdefad tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:51.407903 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-6af8c848-797c-4f63-a383-24540fbdefad tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:51.446361 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-25ba8ce6-0b10-4cc2-8e6c-4fe8a130980b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:51.454324 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-25ba8ce6-0b10-4cc2-8e6c-4fe8a130980b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1321 microversion: 2.1 time: 0.148311 Jun 07 22:03:51.454904 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 46/106] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:51 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1321 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:03:51.544118 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-6af8c848-797c-4f63-a383-24540fbdefad tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:51.551599 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-6af8c848-797c-4f63-a383-24540fbdefad tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1360 microversion: 2.1 time: 0.156280 Jun 07 22:03:51.552170 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 61/107] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:51 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1360 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:03:51.833115 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-e9ea21da-3ffd-499f-9657-657c0ed9f893 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:51.833720 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-e9ea21da-3ffd-499f-9657-657c0ed9f893 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] [instance: b6a3577d-4aaf-4947-95c1-873076371ae7] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:51.840041 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e9ea21da-3ffd-499f-9657-657c0ed9f893 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:51.840487 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e9ea21da-3ffd-499f-9657-657c0ed9f893 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:51.841279 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e9ea21da-3ffd-499f-9657-657c0ed9f893 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:51.841713 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e9ea21da-3ffd-499f-9657-657c0ed9f893 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:51.975603 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-e9ea21da-3ffd-499f-9657-657c0ed9f893 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1378a898f9534635857e5958d32f00c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8d5b4fdf9a48a296359e167017123f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:51.983827 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-e9ea21da-3ffd-499f-9657-657c0ed9f893 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] 10.222.0.13 "GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7" status: 200 len: 1314 microversion: 2.1 time: 0.154517 Jun 07 22:03:51.984395 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 47/108] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:51 2022] GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:03:52.000756 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-1ed66dae-2ba4-49ca-b0fa-26ba6e44346d tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:52.001432 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-1ed66dae-2ba4-49ca-b0fa-26ba6e44346d tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 5704eeef-7ef8-4e6d-b39d-d672e9592836] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:52.007604 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-1ed66dae-2ba4-49ca-b0fa-26ba6e44346d tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:52.008049 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-1ed66dae-2ba4-49ca-b0fa-26ba6e44346d tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:52.008823 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-1ed66dae-2ba4-49ca-b0fa-26ba6e44346d tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:52.009253 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-1ed66dae-2ba4-49ca-b0fa-26ba6e44346d tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:52.137754 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-1ed66dae-2ba4-49ca-b0fa-26ba6e44346d tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:52.145236 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-1ed66dae-2ba4-49ca-b0fa-26ba6e44346d tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836" status: 200 len: 1368 microversion: 2.1 time: 0.148291 Jun 07 22:03:52.145799 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 62/109] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:51 2022] GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836 => generated 1368 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:03:52.470414 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-eeb9dbea-6557-4e18-ba66-fdd9818ba640 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:52.471114 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-eeb9dbea-6557-4e18-ba66-fdd9818ba640 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:52.477439 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-eeb9dbea-6557-4e18-ba66-fdd9818ba640 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:52.477950 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-eeb9dbea-6557-4e18-ba66-fdd9818ba640 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:52.479157 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-eeb9dbea-6557-4e18-ba66-fdd9818ba640 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:52.479979 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-eeb9dbea-6557-4e18-ba66-fdd9818ba640 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:52.484402 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_cell1:SELECT=100 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:03:52.570194 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-36aca591-a286-4a48-ba80-bf54fdff4050 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:52.570194 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-36aca591-a286-4a48-ba80-bf54fdff4050 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:52.575467 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-36aca591-a286-4a48-ba80-bf54fdff4050 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:52.575913 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-36aca591-a286-4a48-ba80-bf54fdff4050 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:52.576673 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-36aca591-a286-4a48-ba80-bf54fdff4050 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:52.582191 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-36aca591-a286-4a48-ba80-bf54fdff4050 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:52.636301 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-eeb9dbea-6557-4e18-ba66-fdd9818ba640 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:52.657073 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-eeb9dbea-6557-4e18-ba66-fdd9818ba640 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1321 microversion: 2.1 time: 0.190430 Jun 07 22:03:52.658081 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 48/110] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:52 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1321 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:03:52.837537 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-36aca591-a286-4a48-ba80-bf54fdff4050 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:52.845979 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-36aca591-a286-4a48-ba80-bf54fdff4050 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1360 microversion: 2.1 time: 0.281430 Jun 07 22:03:52.856763 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 63/111] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:52 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1360 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:03:53.007815 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-21989e66-3780-48c0-96f2-34824c80ce2e tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:53.009309 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-21989e66-3780-48c0-96f2-34824c80ce2e tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] [instance: b6a3577d-4aaf-4947-95c1-873076371ae7] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:53.024506 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-21989e66-3780-48c0-96f2-34824c80ce2e tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:53.027291 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-21989e66-3780-48c0-96f2-34824c80ce2e tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:53.031854 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-21989e66-3780-48c0-96f2-34824c80ce2e tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:53.032499 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-21989e66-3780-48c0-96f2-34824c80ce2e tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:53.162426 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-c31508bb-c91a-4a4b-8868-7b6af612366d tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:53.162985 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-c31508bb-c91a-4a4b-8868-7b6af612366d tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 5704eeef-7ef8-4e6d-b39d-d672e9592836] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:53.181300 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c31508bb-c91a-4a4b-8868-7b6af612366d tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:53.181791 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c31508bb-c91a-4a4b-8868-7b6af612366d tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:53.182576 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c31508bb-c91a-4a4b-8868-7b6af612366d tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:53.183014 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c31508bb-c91a-4a4b-8868-7b6af612366d tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:53.509583 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-c31508bb-c91a-4a4b-8868-7b6af612366d tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:53.517248 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-c31508bb-c91a-4a4b-8868-7b6af612366d tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836" status: 200 len: 1368 microversion: 2.1 time: 0.358875 Jun 07 22:03:53.520188 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 64/112] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:53 2022] GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836 => generated 1368 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:03:53.674952 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-e7a8c98c-eb39-4a93-9182-60d4773315c6 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:53.677045 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-e7a8c98c-eb39-4a93-9182-60d4773315c6 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:53.698451 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e7a8c98c-eb39-4a93-9182-60d4773315c6 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:53.698451 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e7a8c98c-eb39-4a93-9182-60d4773315c6 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:53.698451 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e7a8c98c-eb39-4a93-9182-60d4773315c6 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:53.702009 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e7a8c98c-eb39-4a93-9182-60d4773315c6 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:53.918609 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-21989e66-3780-48c0-96f2-34824c80ce2e tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1378a898f9534635857e5958d32f00c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8d5b4fdf9a48a296359e167017123f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:53.933221 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-21989e66-3780-48c0-96f2-34824c80ce2e tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] 10.222.0.13 "GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7" status: 200 len: 1314 microversion: 2.1 time: 0.936204 Jun 07 22:03:53.936021 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 49/113] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:52 2022] GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7 => generated 1314 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:03:53.943087 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-361b8f9e-ebc8-4bd2-a919-7be15134d431 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:53.943722 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-361b8f9e-ebc8-4bd2-a919-7be15134d431 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:53.959646 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-361b8f9e-ebc8-4bd2-a919-7be15134d431 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:53.960327 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-361b8f9e-ebc8-4bd2-a919-7be15134d431 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:53.961322 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-361b8f9e-ebc8-4bd2-a919-7be15134d431 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:53.961761 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-361b8f9e-ebc8-4bd2-a919-7be15134d431 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:54.018877 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-e7a8c98c-eb39-4a93-9182-60d4773315c6 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:54.030079 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-e7a8c98c-eb39-4a93-9182-60d4773315c6 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1321 microversion: 2.1 time: 0.359091 Jun 07 22:03:54.042508 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 65/114] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:53 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1321 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:03:54.357963 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-361b8f9e-ebc8-4bd2-a919-7be15134d431 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:54.367452 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-361b8f9e-ebc8-4bd2-a919-7be15134d431 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1360 microversion: 2.1 time: 0.429440 Jun 07 22:03:54.368188 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 50/115] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:53 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1360 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:03:54.537726 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-08352fca-19d7-4a9b-a705-2a0e2e1ad9ac tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:54.538583 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-08352fca-19d7-4a9b-a705-2a0e2e1ad9ac tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 5704eeef-7ef8-4e6d-b39d-d672e9592836] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:54.549126 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-08352fca-19d7-4a9b-a705-2a0e2e1ad9ac tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:54.550323 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-08352fca-19d7-4a9b-a705-2a0e2e1ad9ac tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:54.551446 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-08352fca-19d7-4a9b-a705-2a0e2e1ad9ac tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:54.552205 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-08352fca-19d7-4a9b-a705-2a0e2e1ad9ac tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:54.783546 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-08352fca-19d7-4a9b-a705-2a0e2e1ad9ac tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:54.795520 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-08352fca-19d7-4a9b-a705-2a0e2e1ad9ac tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836" status: 200 len: 1368 microversion: 2.1 time: 0.262973 Jun 07 22:03:54.798500 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 66/116] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:54 2022] GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836 => generated 1368 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:03:54.818377 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [req-1ccc157e-e3ae-4c8a-91d8-699bb821cd52 req-25b6e2cc-8d45-4bdb-81a9-0348bd9bbe8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6a3577d-4aaf-4947-95c1-873076371ae7", "name": "network-vif-plugged", "status": "completed", "tag": "013cdc82-ff69-4ef3-8efc-580732459589"}]} {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:03:54.829986 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [req-1ccc157e-e3ae-4c8a-91d8-699bb821cd52 req-25b6e2cc-8d45-4bdb-81a9-0348bd9bbe8c service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:54.830453 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [req-1ccc157e-e3ae-4c8a-91d8-699bb821cd52 req-25b6e2cc-8d45-4bdb-81a9-0348bd9bbe8c service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:54.850203 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.compute.server_external_events [req-1ccc157e-e3ae-4c8a-91d8-699bb821cd52 req-25b6e2cc-8d45-4bdb-81a9-0348bd9bbe8c service nova] Creating event network-vif-plugged:013cdc82-ff69-4ef3-8efc-580732459589 for instance b6a3577d-4aaf-4947-95c1-873076371ae7 on hv-cinder-83552 Jun 07 22:03:54.850995 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [req-1ccc157e-e3ae-4c8a-91d8-699bb821cd52 req-25b6e2cc-8d45-4bdb-81a9-0348bd9bbe8c service nova] Acquired lock "compute-rpcapi-router" {{(pid=117970) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 07 22:03:54.852119 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0a03d92b-5d6c-4661-972d-1ac44f6525ac None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:54.853088 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0a03d92b-5d6c-4661-972d-1ac44f6525ac None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:54.854161 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0a03d92b-5d6c-4661-972d-1ac44f6525ac None None] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:54.854785 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0a03d92b-5d6c-4661-972d-1ac44f6525ac None None] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:54.872417 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [req-c342ce3a-bcda-4311-84b1-ff4b0ff2cc24 req-7bc723fe-6c3c-41b9-8cc4-8d9d4ecbf479 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f29be694-507c-48eb-9fdd-d20bef8f6609", "tag": "b5e13943-f98b-44ed-aa48-c5263e7a75d2"}]} {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:03:54.884131 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.compute.rpcapi [None req-0a03d92b-5d6c-4661-972d-1ac44f6525ac None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 07 22:03:54.886073 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0a03d92b-5d6c-4661-972d-1ac44f6525ac None None] Releasing lock "compute-rpcapi-router" {{(pid=117970) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 07 22:03:54.889030 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-c342ce3a-bcda-4311-84b1-ff4b0ff2cc24 req-7bc723fe-6c3c-41b9-8cc4-8d9d4ecbf479 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:54.893199 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-c342ce3a-bcda-4311-84b1-ff4b0ff2cc24 req-7bc723fe-6c3c-41b9-8cc4-8d9d4ecbf479 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:54.912458 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.compute.server_external_events [req-c342ce3a-bcda-4311-84b1-ff4b0ff2cc24 req-7bc723fe-6c3c-41b9-8cc4-8d9d4ecbf479 service nova] Creating event network-changed:b5e13943-f98b-44ed-aa48-c5263e7a75d2 for instance f29be694-507c-48eb-9fdd-d20bef8f6609 on hv-cinder-83552 Jun 07 22:03:54.930779 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [req-c342ce3a-bcda-4311-84b1-ff4b0ff2cc24 req-7bc723fe-6c3c-41b9-8cc4-8d9d4ecbf479 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064062 Jun 07 22:03:54.932545 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 67/117] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:03:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 22:03:54.957359 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-923708ea-c260-4a7f-93c6-40c77c21e00c tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:54.958247 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-923708ea-c260-4a7f-93c6-40c77c21e00c tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] [instance: b6a3577d-4aaf-4947-95c1-873076371ae7] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:54.962198 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-0a03d92b-5d6c-4661-972d-1ac44f6525ac None None] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.241162 Jun 07 22:03:54.965507 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 51/118] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:03:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:03:54.972964 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-923708ea-c260-4a7f-93c6-40c77c21e00c tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:54.973709 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-923708ea-c260-4a7f-93c6-40c77c21e00c tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:54.974852 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-923708ea-c260-4a7f-93c6-40c77c21e00c tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:54.975516 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-923708ea-c260-4a7f-93c6-40c77c21e00c tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:55.049790 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-598647ad-9045-4419-90c6-2ec3fb8ce00e tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:55.050611 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-598647ad-9045-4419-90c6-2ec3fb8ce00e tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:55.059177 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-598647ad-9045-4419-90c6-2ec3fb8ce00e tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:55.059824 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-598647ad-9045-4419-90c6-2ec3fb8ce00e tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:55.060685 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-598647ad-9045-4419-90c6-2ec3fb8ce00e tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:55.067209 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-598647ad-9045-4419-90c6-2ec3fb8ce00e tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:55.168587 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-923708ea-c260-4a7f-93c6-40c77c21e00c tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1378a898f9534635857e5958d32f00c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8d5b4fdf9a48a296359e167017123f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:55.181499 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-923708ea-c260-4a7f-93c6-40c77c21e00c tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] 10.222.0.13 "GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7" status: 200 len: 1314 microversion: 2.1 time: 0.232458 Jun 07 22:03:55.192161 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 68/119] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:54 2022] GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7 => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:03:55.261019 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-598647ad-9045-4419-90c6-2ec3fb8ce00e tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:55.268728 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-598647ad-9045-4419-90c6-2ec3fb8ce00e tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1321 microversion: 2.1 time: 0.223574 Jun 07 22:03:55.269354 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 52/120] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:55 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1321 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:03:55.386361 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-046370cb-316f-4006-80f2-acc0dda97a29 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:55.386960 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-046370cb-316f-4006-80f2-acc0dda97a29 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:55.392973 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-046370cb-316f-4006-80f2-acc0dda97a29 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:55.393405 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-046370cb-316f-4006-80f2-acc0dda97a29 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:55.394145 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-046370cb-316f-4006-80f2-acc0dda97a29 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:55.394570 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-046370cb-316f-4006-80f2-acc0dda97a29 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:55.520679 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-046370cb-316f-4006-80f2-acc0dda97a29 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:55.528846 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-046370cb-316f-4006-80f2-acc0dda97a29 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1360 microversion: 2.1 time: 0.147151 Jun 07 22:03:55.529441 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 69/121] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:55 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1360 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:03:55.812844 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-1ffa148e-985b-4d75-b806-22caef7d9353 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:55.813457 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-1ffa148e-985b-4d75-b806-22caef7d9353 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 5704eeef-7ef8-4e6d-b39d-d672e9592836] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:55.815461 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:03:55.820905 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1ffa148e-985b-4d75-b806-22caef7d9353 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:55.821355 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1ffa148e-985b-4d75-b806-22caef7d9353 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:55.822110 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1ffa148e-985b-4d75-b806-22caef7d9353 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:55.823347 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1ffa148e-985b-4d75-b806-22caef7d9353 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:55.953306 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-1ffa148e-985b-4d75-b806-22caef7d9353 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:55.960868 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-1ffa148e-985b-4d75-b806-22caef7d9353 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836" status: 200 len: 1368 microversion: 2.1 time: 0.152180 Jun 07 22:03:55.961430 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 53/122] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:55 2022] GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:03:56.198736 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-2d7658eb-3ec8-4455-b804-72ed94052514 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:56.199345 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-2d7658eb-3ec8-4455-b804-72ed94052514 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] [instance: b6a3577d-4aaf-4947-95c1-873076371ae7] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:56.205372 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-2d7658eb-3ec8-4455-b804-72ed94052514 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:56.205817 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-2d7658eb-3ec8-4455-b804-72ed94052514 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:56.206652 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-2d7658eb-3ec8-4455-b804-72ed94052514 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:56.207093 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-2d7658eb-3ec8-4455-b804-72ed94052514 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:56.286165 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-517b9346-75f6-4008-95d2-b1886ac343f0 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:56.286796 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-517b9346-75f6-4008-95d2-b1886ac343f0 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:56.293440 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-517b9346-75f6-4008-95d2-b1886ac343f0 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:56.293884 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-517b9346-75f6-4008-95d2-b1886ac343f0 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:56.294666 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-517b9346-75f6-4008-95d2-b1886ac343f0 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:56.295097 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-517b9346-75f6-4008-95d2-b1886ac343f0 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:56.344285 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-2d7658eb-3ec8-4455-b804-72ed94052514 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1378a898f9534635857e5958d32f00c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8d5b4fdf9a48a296359e167017123f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:56.349274 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_cell1:SELECT=100 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:03:56.365597 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-2d7658eb-3ec8-4455-b804-72ed94052514 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] 10.222.0.13 "GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7" status: 200 len: 1314 microversion: 2.1 time: 0.170722 Jun 07 22:03:56.366180 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 70/123] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:56 2022] GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:03:56.436551 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-517b9346-75f6-4008-95d2-b1886ac343f0 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:56.444116 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-517b9346-75f6-4008-95d2-b1886ac343f0 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1321 microversion: 2.1 time: 0.161793 Jun 07 22:03:56.444711 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 54/124] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:56 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:03:56.547030 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-a8c16b17-17d2-4305-b577-52de3e359a62 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:56.547692 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-a8c16b17-17d2-4305-b577-52de3e359a62 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:56.553737 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a8c16b17-17d2-4305-b577-52de3e359a62 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:56.554185 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a8c16b17-17d2-4305-b577-52de3e359a62 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:56.554936 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a8c16b17-17d2-4305-b577-52de3e359a62 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:56.555401 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a8c16b17-17d2-4305-b577-52de3e359a62 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:56.683831 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-a8c16b17-17d2-4305-b577-52de3e359a62 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:56.691292 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-a8c16b17-17d2-4305-b577-52de3e359a62 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1360 microversion: 2.1 time: 0.148179 Jun 07 22:03:56.691870 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 71/125] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:56 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1360 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:03:56.946084 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [req-d0a974b5-0d35-4ff0-829e-5cfa312e3dd7 req-6c45b5b6-8ad9-4871-9863-5ab99a3a6ba2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5704eeef-7ef8-4e6d-b39d-d672e9592836", "tag": "f75804a7-9ce5-44ca-82e4-e1f8a373373a"}]} {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:03:56.954711 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [req-d0a974b5-0d35-4ff0-829e-5cfa312e3dd7 req-6c45b5b6-8ad9-4871-9863-5ab99a3a6ba2 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:56.955149 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [req-d0a974b5-0d35-4ff0-829e-5cfa312e3dd7 req-6c45b5b6-8ad9-4871-9863-5ab99a3a6ba2 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:56.966819 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.compute.server_external_events [req-d0a974b5-0d35-4ff0-829e-5cfa312e3dd7 req-6c45b5b6-8ad9-4871-9863-5ab99a3a6ba2 service nova] Creating event network-changed:f75804a7-9ce5-44ca-82e4-e1f8a373373a for instance 5704eeef-7ef8-4e6d-b39d-d672e9592836 on hv-cinder-83552 Jun 07 22:03:56.972001 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [req-d0a974b5-0d35-4ff0-829e-5cfa312e3dd7 req-6c45b5b6-8ad9-4871-9863-5ab99a3a6ba2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029532 Jun 07 22:03:56.972596 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 55/126] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:03:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:03:56.978485 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-dd2f47cb-f605-46bc-9d13-c74b491fad35 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:56.979286 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-dd2f47cb-f605-46bc-9d13-c74b491fad35 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 5704eeef-7ef8-4e6d-b39d-d672e9592836] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:56.987402 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-dd2f47cb-f605-46bc-9d13-c74b491fad35 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:56.990011 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-dd2f47cb-f605-46bc-9d13-c74b491fad35 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:56.990011 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-dd2f47cb-f605-46bc-9d13-c74b491fad35 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:56.990011 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-dd2f47cb-f605-46bc-9d13-c74b491fad35 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:57.145207 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-dd2f47cb-f605-46bc-9d13-c74b491fad35 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:57.153535 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-dd2f47cb-f605-46bc-9d13-c74b491fad35 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836" status: 200 len: 1368 microversion: 2.1 time: 0.179696 Jun 07 22:03:57.154093 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 72/127] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:56 2022] GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836 => generated 1368 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:03:57.383630 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-c9eb1388-1380-40d7-a372-eb083f0a2525 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:57.384380 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-c9eb1388-1380-40d7-a372-eb083f0a2525 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] [instance: b6a3577d-4aaf-4947-95c1-873076371ae7] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:57.391662 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c9eb1388-1380-40d7-a372-eb083f0a2525 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:57.392184 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c9eb1388-1380-40d7-a372-eb083f0a2525 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:57.392981 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c9eb1388-1380-40d7-a372-eb083f0a2525 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:57.393419 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c9eb1388-1380-40d7-a372-eb083f0a2525 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:57.459882 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-0bd8c89c-91be-4852-8385-70ac5ded6547 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:57.460568 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-0bd8c89c-91be-4852-8385-70ac5ded6547 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:57.462494 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:03:57.469112 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-0bd8c89c-91be-4852-8385-70ac5ded6547 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:57.469602 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-0bd8c89c-91be-4852-8385-70ac5ded6547 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:57.470381 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-0bd8c89c-91be-4852-8385-70ac5ded6547 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:57.470812 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-0bd8c89c-91be-4852-8385-70ac5ded6547 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:57.552643 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-c9eb1388-1380-40d7-a372-eb083f0a2525 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1378a898f9534635857e5958d32f00c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8d5b4fdf9a48a296359e167017123f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:57.560757 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-c9eb1388-1380-40d7-a372-eb083f0a2525 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] 10.222.0.13 "GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7" status: 200 len: 1314 microversion: 2.1 time: 0.181325 Jun 07 22:03:57.561327 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 56/128] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:57 2022] GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:03:57.611246 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-0bd8c89c-91be-4852-8385-70ac5ded6547 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:57.619106 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-0bd8c89c-91be-4852-8385-70ac5ded6547 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1321 microversion: 2.1 time: 0.163179 Jun 07 22:03:57.620355 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 73/129] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:57 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1321 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:03:57.708570 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-e5412baf-e059-4c1c-aba3-48b7a9747e9c tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:57.709181 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-e5412baf-e059-4c1c-aba3-48b7a9747e9c tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:57.715264 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e5412baf-e059-4c1c-aba3-48b7a9747e9c tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:57.715747 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e5412baf-e059-4c1c-aba3-48b7a9747e9c tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:57.716507 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e5412baf-e059-4c1c-aba3-48b7a9747e9c tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:57.716945 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e5412baf-e059-4c1c-aba3-48b7a9747e9c tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:57.986210 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-e5412baf-e059-4c1c-aba3-48b7a9747e9c tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:57.993580 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-e5412baf-e059-4c1c-aba3-48b7a9747e9c tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1360 microversion: 2.1 time: 0.288950 Jun 07 22:03:57.994143 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 57/130] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:57 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1360 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:03:58.170799 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-cf1908e3-5708-4676-8de2-fc0c7f4a94da tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:58.171318 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-cf1908e3-5708-4676-8de2-fc0c7f4a94da tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 5704eeef-7ef8-4e6d-b39d-d672e9592836] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:58.177436 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-cf1908e3-5708-4676-8de2-fc0c7f4a94da tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:58.177879 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-cf1908e3-5708-4676-8de2-fc0c7f4a94da tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:58.178626 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-cf1908e3-5708-4676-8de2-fc0c7f4a94da tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:58.179056 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-cf1908e3-5708-4676-8de2-fc0c7f4a94da tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:58.307643 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-cf1908e3-5708-4676-8de2-fc0c7f4a94da tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:58.315132 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-cf1908e3-5708-4676-8de2-fc0c7f4a94da tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836" status: 200 len: 1368 microversion: 2.1 time: 0.148997 Jun 07 22:03:58.315719 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 74/131] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:58 2022] GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836 => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:03:58.578258 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-8e69b967-3f87-4b46-90ff-d9cf4df10a7a tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:58.578871 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-8e69b967-3f87-4b46-90ff-d9cf4df10a7a tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] [instance: b6a3577d-4aaf-4947-95c1-873076371ae7] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:58.584859 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-8e69b967-3f87-4b46-90ff-d9cf4df10a7a tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:58.585303 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-8e69b967-3f87-4b46-90ff-d9cf4df10a7a tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:58.586053 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-8e69b967-3f87-4b46-90ff-d9cf4df10a7a tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:58.586505 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-8e69b967-3f87-4b46-90ff-d9cf4df10a7a tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:58.637225 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-fc598ebb-8047-4f88-96c7-04b4d26f050c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:58.637967 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-fc598ebb-8047-4f88-96c7-04b4d26f050c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:58.644270 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-fc598ebb-8047-4f88-96c7-04b4d26f050c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:58.644763 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-fc598ebb-8047-4f88-96c7-04b4d26f050c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:58.645576 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-fc598ebb-8047-4f88-96c7-04b4d26f050c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:58.646013 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-fc598ebb-8047-4f88-96c7-04b4d26f050c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:58.717008 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-8e69b967-3f87-4b46-90ff-d9cf4df10a7a tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1378a898f9534635857e5958d32f00c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8d5b4fdf9a48a296359e167017123f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:58.724918 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-8e69b967-3f87-4b46-90ff-d9cf4df10a7a tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] 10.222.0.13 "GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7" status: 200 len: 1314 microversion: 2.1 time: 0.150594 Jun 07 22:03:58.725536 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 58/132] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:58 2022] GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:03:58.774283 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-fc598ebb-8047-4f88-96c7-04b4d26f050c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:58.782624 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-fc598ebb-8047-4f88-96c7-04b4d26f050c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1321 microversion: 2.1 time: 0.149939 Jun 07 22:03:58.783293 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 75/133] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:58 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:03:59.010039 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-02ac0e8a-823e-4169-baf4-2679aab8237a tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:59.011190 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-02ac0e8a-823e-4169-baf4-2679aab8237a tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:59.017475 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-02ac0e8a-823e-4169-baf4-2679aab8237a tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:59.017915 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-02ac0e8a-823e-4169-baf4-2679aab8237a tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:59.018657 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-02ac0e8a-823e-4169-baf4-2679aab8237a tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:59.019081 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-02ac0e8a-823e-4169-baf4-2679aab8237a tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:59.147641 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-02ac0e8a-823e-4169-baf4-2679aab8237a tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:59.155759 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-02ac0e8a-823e-4169-baf4-2679aab8237a tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1360 microversion: 2.1 time: 0.149605 Jun 07 22:03:59.156345 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 59/134] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:59 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1360 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:03:59.332346 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-6b2a57f3-d3c2-4c8c-b36e-7d9239c54d54 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:59.332954 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-6b2a57f3-d3c2-4c8c-b36e-7d9239c54d54 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 5704eeef-7ef8-4e6d-b39d-d672e9592836] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:59.339677 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-6b2a57f3-d3c2-4c8c-b36e-7d9239c54d54 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:59.340118 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-6b2a57f3-d3c2-4c8c-b36e-7d9239c54d54 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:59.340864 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-6b2a57f3-d3c2-4c8c-b36e-7d9239c54d54 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:59.341296 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-6b2a57f3-d3c2-4c8c-b36e-7d9239c54d54 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:59.471304 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-6b2a57f3-d3c2-4c8c-b36e-7d9239c54d54 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:59.482043 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-6b2a57f3-d3c2-4c8c-b36e-7d9239c54d54 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836" status: 200 len: 1368 microversion: 2.1 time: 0.153479 Jun 07 22:03:59.482732 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 76/135] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:59 2022] GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:03:59.741833 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-b665a6b4-d369-45b0-bd43-2c4e3bfaed0c tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:59.742436 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-b665a6b4-d369-45b0-bd43-2c4e3bfaed0c tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] [instance: b6a3577d-4aaf-4947-95c1-873076371ae7] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:59.749016 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-b665a6b4-d369-45b0-bd43-2c4e3bfaed0c tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:59.749707 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-b665a6b4-d369-45b0-bd43-2c4e3bfaed0c tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:59.750452 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-b665a6b4-d369-45b0-bd43-2c4e3bfaed0c tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:59.750879 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-b665a6b4-d369-45b0-bd43-2c4e3bfaed0c tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:59.801173 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-dc9fa25b-7187-48d5-8572-a9f49e034bf7 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:03:59.802078 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-dc9fa25b-7187-48d5-8572-a9f49e034bf7 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:03:59.808409 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-dc9fa25b-7187-48d5-8572-a9f49e034bf7 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:59.808882 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-dc9fa25b-7187-48d5-8572-a9f49e034bf7 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:59.809639 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-dc9fa25b-7187-48d5-8572-a9f49e034bf7 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:03:59.810244 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-dc9fa25b-7187-48d5-8572-a9f49e034bf7 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:03:59.889488 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-b665a6b4-d369-45b0-bd43-2c4e3bfaed0c tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1378a898f9534635857e5958d32f00c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8d5b4fdf9a48a296359e167017123f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:59.897341 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-b665a6b4-d369-45b0-bd43-2c4e3bfaed0c tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] 10.222.0.13 "GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7" status: 200 len: 1314 microversion: 2.1 time: 0.159133 Jun 07 22:03:59.897700 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 60/136] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:59 2022] GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:03:59.952450 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-dc9fa25b-7187-48d5-8572-a9f49e034bf7 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:03:59.961642 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-dc9fa25b-7187-48d5-8572-a9f49e034bf7 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1321 microversion: 2.1 time: 0.164666 Jun 07 22:03:59.962213 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 77/137] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:03:59 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1321 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:04:00.173503 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-7fc67339-0de6-4b60-8d70-082b29fd1f4d tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:00.174038 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-7fc67339-0de6-4b60-8d70-082b29fd1f4d tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:00.180023 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-7fc67339-0de6-4b60-8d70-082b29fd1f4d tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:00.180462 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-7fc67339-0de6-4b60-8d70-082b29fd1f4d tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:00.181215 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-7fc67339-0de6-4b60-8d70-082b29fd1f4d tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:00.181695 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-7fc67339-0de6-4b60-8d70-082b29fd1f4d tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:00.316082 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-7fc67339-0de6-4b60-8d70-082b29fd1f4d tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:00.329390 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-7fc67339-0de6-4b60-8d70-082b29fd1f4d tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1360 microversion: 2.1 time: 0.155417 Jun 07 22:04:00.330042 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 61/138] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:00 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1360 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:00.500272 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-e9bb2187-39e3-4f3f-9c93-234b694905aa tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:00.500936 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-e9bb2187-39e3-4f3f-9c93-234b694905aa tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 5704eeef-7ef8-4e6d-b39d-d672e9592836] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:00.506724 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e9bb2187-39e3-4f3f-9c93-234b694905aa tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:00.507156 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e9bb2187-39e3-4f3f-9c93-234b694905aa tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:00.507954 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e9bb2187-39e3-4f3f-9c93-234b694905aa tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:00.508410 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e9bb2187-39e3-4f3f-9c93-234b694905aa tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:00.803707 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-e9bb2187-39e3-4f3f-9c93-234b694905aa tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:00.812652 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-e9bb2187-39e3-4f3f-9c93-234b694905aa tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836" status: 200 len: 1368 microversion: 2.1 time: 0.316536 Jun 07 22:04:00.815448 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 78/139] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:00 2022] GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836 => generated 1368 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:00.914571 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-f9401ed8-72f3-4db1-93e1-f23a43b3b30b tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:00.915917 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-f9401ed8-72f3-4db1-93e1-f23a43b3b30b tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] [instance: b6a3577d-4aaf-4947-95c1-873076371ae7] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:00.937451 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f9401ed8-72f3-4db1-93e1-f23a43b3b30b tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:00.938059 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f9401ed8-72f3-4db1-93e1-f23a43b3b30b tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:00.939009 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f9401ed8-72f3-4db1-93e1-f23a43b3b30b tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:00.939770 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f9401ed8-72f3-4db1-93e1-f23a43b3b30b tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:00.980327 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-eb986ba5-96c2-42c7-bc6f-2389d866d327 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:00.981173 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-eb986ba5-96c2-42c7-bc6f-2389d866d327 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:01.001570 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-eb986ba5-96c2-42c7-bc6f-2389d866d327 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:01.004258 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-eb986ba5-96c2-42c7-bc6f-2389d866d327 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:01.005502 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-eb986ba5-96c2-42c7-bc6f-2389d866d327 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:01.007851 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-eb986ba5-96c2-42c7-bc6f-2389d866d327 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:01.220737 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-f9401ed8-72f3-4db1-93e1-f23a43b3b30b tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1378a898f9534635857e5958d32f00c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8d5b4fdf9a48a296359e167017123f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:01.231704 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-f9401ed8-72f3-4db1-93e1-f23a43b3b30b tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] 10.222.0.13 "GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7" status: 200 len: 1314 microversion: 2.1 time: 0.319897 Jun 07 22:04:01.242956 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 62/140] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:00 2022] GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7 => generated 1314 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:01.349217 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-7740fdbe-10f0-4956-8a04-9517844950d5 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:01.350349 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-7740fdbe-10f0-4956-8a04-9517844950d5 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:01.358792 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-7740fdbe-10f0-4956-8a04-9517844950d5 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:01.359471 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-7740fdbe-10f0-4956-8a04-9517844950d5 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:01.360390 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-7740fdbe-10f0-4956-8a04-9517844950d5 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:01.361098 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-7740fdbe-10f0-4956-8a04-9517844950d5 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:01.484915 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-eb986ba5-96c2-42c7-bc6f-2389d866d327 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:01.498012 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-eb986ba5-96c2-42c7-bc6f-2389d866d327 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1321 microversion: 2.1 time: 0.522341 Jun 07 22:04:01.507976 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 79/141] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:00 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1321 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:01.771526 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-7740fdbe-10f0-4956-8a04-9517844950d5 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:01.780669 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-7740fdbe-10f0-4956-8a04-9517844950d5 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1360 microversion: 2.1 time: 0.435604 Jun 07 22:04:01.781249 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 63/142] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:01 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1360 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:04:01.832059 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-fad5be8c-9621-4d7f-b239-bbd746369f77 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:01.832678 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-fad5be8c-9621-4d7f-b239-bbd746369f77 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 5704eeef-7ef8-4e6d-b39d-d672e9592836] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:01.839343 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-fad5be8c-9621-4d7f-b239-bbd746369f77 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:01.839900 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-fad5be8c-9621-4d7f-b239-bbd746369f77 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:01.840559 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-fad5be8c-9621-4d7f-b239-bbd746369f77 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:01.840994 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-fad5be8c-9621-4d7f-b239-bbd746369f77 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:01.976859 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-fad5be8c-9621-4d7f-b239-bbd746369f77 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:01.987414 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-fad5be8c-9621-4d7f-b239-bbd746369f77 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836" status: 200 len: 1368 microversion: 2.1 time: 0.159366 Jun 07 22:04:01.988422 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 80/143] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:01 2022] GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836 => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:02.250766 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-608ffd8a-a29f-40aa-b628-1ac2f240e3bf tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:02.251621 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-608ffd8a-a29f-40aa-b628-1ac2f240e3bf tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] [instance: b6a3577d-4aaf-4947-95c1-873076371ae7] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:02.260158 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-608ffd8a-a29f-40aa-b628-1ac2f240e3bf tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:02.260858 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-608ffd8a-a29f-40aa-b628-1ac2f240e3bf tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:02.261875 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-608ffd8a-a29f-40aa-b628-1ac2f240e3bf tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:02.262581 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-608ffd8a-a29f-40aa-b628-1ac2f240e3bf tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:02.516147 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-7a826840-e759-4c3b-b3bb-bacc5ca1a877 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:02.516934 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-7a826840-e759-4c3b-b3bb-bacc5ca1a877 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:02.524982 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-7a826840-e759-4c3b-b3bb-bacc5ca1a877 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:02.525598 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-7a826840-e759-4c3b-b3bb-bacc5ca1a877 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:02.527127 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-7a826840-e759-4c3b-b3bb-bacc5ca1a877 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:02.527740 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-7a826840-e759-4c3b-b3bb-bacc5ca1a877 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:02.686706 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-7a826840-e759-4c3b-b3bb-bacc5ca1a877 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:02.694789 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-7a826840-e759-4c3b-b3bb-bacc5ca1a877 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1321 microversion: 2.1 time: 0.183363 Jun 07 22:04:02.695587 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 81/144] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:02 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1321 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:02.797478 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-995a81a3-5311-436c-b3ad-3f77c17e1b1e tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:02.798086 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-995a81a3-5311-436c-b3ad-3f77c17e1b1e tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:02.804066 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-995a81a3-5311-436c-b3ad-3f77c17e1b1e tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:02.804503 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-995a81a3-5311-436c-b3ad-3f77c17e1b1e tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:02.805276 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-995a81a3-5311-436c-b3ad-3f77c17e1b1e tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:02.805696 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-995a81a3-5311-436c-b3ad-3f77c17e1b1e tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:02.924612 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-608ffd8a-a29f-40aa-b628-1ac2f240e3bf tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1378a898f9534635857e5958d32f00c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8d5b4fdf9a48a296359e167017123f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:02.939945 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-608ffd8a-a29f-40aa-b628-1ac2f240e3bf tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] 10.222.0.13 "GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7" status: 200 len: 1314 microversion: 2.1 time: 0.693271 Jun 07 22:04:02.940540 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 64/145] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:02 2022] GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7 => generated 1314 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:02.997379 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-995a81a3-5311-436c-b3ad-3f77c17e1b1e tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:03.008295 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-97246624-12a1-42dd-b17a-9154fcb20889 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:03.008503 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-995a81a3-5311-436c-b3ad-3f77c17e1b1e tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1360 microversion: 2.1 time: 0.214685 Jun 07 22:04:03.009382 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-97246624-12a1-42dd-b17a-9154fcb20889 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 5704eeef-7ef8-4e6d-b39d-d672e9592836] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:03.009492 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 82/146] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:02 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1360 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:04:03.018156 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-97246624-12a1-42dd-b17a-9154fcb20889 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:03.018601 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-97246624-12a1-42dd-b17a-9154fcb20889 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:03.019400 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-97246624-12a1-42dd-b17a-9154fcb20889 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:03.027809 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-97246624-12a1-42dd-b17a-9154fcb20889 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:03.298394 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-97246624-12a1-42dd-b17a-9154fcb20889 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:03.306709 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_cell1:SELECT=100 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:04:03.310517 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-97246624-12a1-42dd-b17a-9154fcb20889 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836" status: 200 len: 1368 microversion: 2.1 time: 0.307561 Jun 07 22:04:03.311279 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 65/147] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:03 2022] GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836 => generated 1368 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:04:03.715572 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-0068d659-fab5-4214-ad3c-c2bdd1f10b2a tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:03.716515 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-0068d659-fab5-4214-ad3c-c2bdd1f10b2a tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:03.722793 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-0068d659-fab5-4214-ad3c-c2bdd1f10b2a tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:03.723271 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-0068d659-fab5-4214-ad3c-c2bdd1f10b2a tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:03.724086 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-0068d659-fab5-4214-ad3c-c2bdd1f10b2a tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:03.724870 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-0068d659-fab5-4214-ad3c-c2bdd1f10b2a tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:03.886759 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-0068d659-fab5-4214-ad3c-c2bdd1f10b2a tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:03.896606 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-0068d659-fab5-4214-ad3c-c2bdd1f10b2a tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1321 microversion: 2.1 time: 0.185852 Jun 07 22:04:03.897490 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 83/148] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:03 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1321 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:03.957979 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-29206735-f485-47aa-9905-d94a695b9bb9 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:03.958666 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-29206735-f485-47aa-9905-d94a695b9bb9 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] [instance: b6a3577d-4aaf-4947-95c1-873076371ae7] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:03.966224 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-29206735-f485-47aa-9905-d94a695b9bb9 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:03.966778 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-29206735-f485-47aa-9905-d94a695b9bb9 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:03.967660 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-29206735-f485-47aa-9905-d94a695b9bb9 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:03.968105 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-29206735-f485-47aa-9905-d94a695b9bb9 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:04.027454 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-604ff488-5ab6-4c65-b36e-7833c95923e5 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:04.028202 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-604ff488-5ab6-4c65-b36e-7833c95923e5 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:04.035826 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-604ff488-5ab6-4c65-b36e-7833c95923e5 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:04.036283 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-604ff488-5ab6-4c65-b36e-7833c95923e5 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:04.037050 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-604ff488-5ab6-4c65-b36e-7833c95923e5 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:04.037491 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-604ff488-5ab6-4c65-b36e-7833c95923e5 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:04.137033 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-29206735-f485-47aa-9905-d94a695b9bb9 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1378a898f9534635857e5958d32f00c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8d5b4fdf9a48a296359e167017123f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:04.146409 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-29206735-f485-47aa-9905-d94a695b9bb9 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] 10.222.0.13 "GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7" status: 200 len: 1502 microversion: 2.1 time: 0.192504 Jun 07 22:04:04.159991 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 66/149] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:03 2022] GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7 => generated 1502 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:04.245451 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-604ff488-5ab6-4c65-b36e-7833c95923e5 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:04.263810 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-604ff488-5ab6-4c65-b36e-7833c95923e5 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1360 microversion: 2.1 time: 0.241035 Jun 07 22:04:04.264792 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 84/150] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:04 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1360 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:04.330261 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-711241e8-06d3-4765-a2af-7e82f150da0b tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:04.331763 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-711241e8-06d3-4765-a2af-7e82f150da0b tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 5704eeef-7ef8-4e6d-b39d-d672e9592836] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:04.355895 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-711241e8-06d3-4765-a2af-7e82f150da0b tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:04.356351 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-711241e8-06d3-4765-a2af-7e82f150da0b tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:04.359722 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-711241e8-06d3-4765-a2af-7e82f150da0b tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:04.360217 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-711241e8-06d3-4765-a2af-7e82f150da0b tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:04.548444 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [req-fefbb67f-6728-4d16-a3a5-5162bc3731b8 req-79349557-c190-4e72-a4d5-e3fed78df341 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92b3a56b-7d09-4772-b1e4-c75b3971f7a5", "name": "network-vif-plugged", "status": "completed", "tag": "94c4dc88-ce6e-456a-a929-9e88a1b3df7d"}]} {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:04:04.561895 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-fefbb67f-6728-4d16-a3a5-5162bc3731b8 req-79349557-c190-4e72-a4d5-e3fed78df341 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:04.564299 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-fefbb67f-6728-4d16-a3a5-5162bc3731b8 req-79349557-c190-4e72-a4d5-e3fed78df341 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:04.585861 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.compute.server_external_events [req-fefbb67f-6728-4d16-a3a5-5162bc3731b8 req-79349557-c190-4e72-a4d5-e3fed78df341 service nova] Creating event network-vif-plugged:94c4dc88-ce6e-456a-a929-9e88a1b3df7d for instance 92b3a56b-7d09-4772-b1e4-c75b3971f7a5 on hv-cinder-83552 Jun 07 22:04:04.602541 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [req-fefbb67f-6728-4d16-a3a5-5162bc3731b8 req-79349557-c190-4e72-a4d5-e3fed78df341 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055296 Jun 07 22:04:04.603581 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 85/151] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:04:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:04:04.645753 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-711241e8-06d3-4765-a2af-7e82f150da0b tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:04.655173 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-711241e8-06d3-4765-a2af-7e82f150da0b tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836" status: 200 len: 1368 microversion: 2.1 time: 0.331102 Jun 07 22:04:04.667269 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 67/152] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:04 2022] GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836 => generated 1368 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:04.916300 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-25d111c0-dd0b-4909-a816-d103a64b3852 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:04.918054 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-25d111c0-dd0b-4909-a816-d103a64b3852 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:04.929679 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-25d111c0-dd0b-4909-a816-d103a64b3852 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:04.930142 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-25d111c0-dd0b-4909-a816-d103a64b3852 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:04.930901 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-25d111c0-dd0b-4909-a816-d103a64b3852 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:04.932512 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-25d111c0-dd0b-4909-a816-d103a64b3852 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:05.101242 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-25d111c0-dd0b-4909-a816-d103a64b3852 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:05.110341 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-25d111c0-dd0b-4909-a816-d103a64b3852 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1321 microversion: 2.1 time: 0.198778 Jun 07 22:04:05.111224 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 86/153] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:04 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1321 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:05.283270 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-93403aff-f633-4c06-9e11-4d708cccd082 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:05.284542 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-93403aff-f633-4c06-9e11-4d708cccd082 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:05.289408 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_cell0:SELECT=2 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:04:05.297760 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-93403aff-f633-4c06-9e11-4d708cccd082 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:05.298210 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-93403aff-f633-4c06-9e11-4d708cccd082 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:05.299626 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-93403aff-f633-4c06-9e11-4d708cccd082 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:05.300668 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-93403aff-f633-4c06-9e11-4d708cccd082 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:05.462449 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-93403aff-f633-4c06-9e11-4d708cccd082 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:05.472230 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-93403aff-f633-4c06-9e11-4d708cccd082 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1360 microversion: 2.1 time: 0.194627 Jun 07 22:04:05.473649 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 68/154] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:05 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1360 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:05.641168 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-d871f4f3-98ea-484e-a423-3c65486b4f63 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1263a81a-3040-44a1-9f89-42356c69c4b4"}} {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:04:05.642289 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-d871f4f3-98ea-484e-a423-3c65486b4f63 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] [instance: b6a3577d-4aaf-4947-95c1-873076371ae7] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:05.648696 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-d871f4f3-98ea-484e-a423-3c65486b4f63 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:05.649149 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-d871f4f3-98ea-484e-a423-3c65486b4f63 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:05.649982 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-d871f4f3-98ea-484e-a423-3c65486b4f63 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:05.650416 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-d871f4f3-98ea-484e-a423-3c65486b4f63 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:05.672952 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-1db9d7b9-9d0e-42d0-aef2-144114fc02cc tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:05.673647 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-1db9d7b9-9d0e-42d0-aef2-144114fc02cc tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 5704eeef-7ef8-4e6d-b39d-d672e9592836] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:05.683432 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1db9d7b9-9d0e-42d0-aef2-144114fc02cc tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:05.686370 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1db9d7b9-9d0e-42d0-aef2-144114fc02cc tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:05.687445 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1db9d7b9-9d0e-42d0-aef2-144114fc02cc tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:05.688200 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1db9d7b9-9d0e-42d0-aef2-144114fc02cc tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:06.077956 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:04:06.107271 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-1db9d7b9-9d0e-42d0-aef2-144114fc02cc tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:06.127525 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-1db9d7b9-9d0e-42d0-aef2-144114fc02cc tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836" status: 200 len: 1368 microversion: 2.1 time: 0.458292 Jun 07 22:04:06.127985 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 69/155] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:05 2022] GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836 => generated 1368 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:04:06.137849 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-0fd1928b-73ce-4b3b-9464-ddc4837ff461 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:06.142036 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-0fd1928b-73ce-4b3b-9464-ddc4837ff461 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:06.155368 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0fd1928b-73ce-4b3b-9464-ddc4837ff461 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:06.156191 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0fd1928b-73ce-4b3b-9464-ddc4837ff461 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:06.158649 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0fd1928b-73ce-4b3b-9464-ddc4837ff461 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:06.160167 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0fd1928b-73ce-4b3b-9464-ddc4837ff461 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:06.408795 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-d871f4f3-98ea-484e-a423-3c65486b4f63 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] 10.222.0.13 "POST /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.770356 Jun 07 22:04:06.415369 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 87/156] 10.222.0.13 () {60 vars in 1322 bytes} [Tue Jun 7 22:04:05 2022] POST /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7/os-volume_attachments => generated 194 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:04:06.459832 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-0fd1928b-73ce-4b3b-9464-ddc4837ff461 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:06.470072 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-0fd1928b-73ce-4b3b-9464-ddc4837ff461 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1321 microversion: 2.1 time: 0.340626 Jun 07 22:04:06.472337 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 70/157] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:06 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1321 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:06.494200 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-c83e5c14-fec7-49f2-a7ab-46db148340b4 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:06.495927 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-c83e5c14-fec7-49f2-a7ab-46db148340b4 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:06.505551 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c83e5c14-fec7-49f2-a7ab-46db148340b4 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:06.517002 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c83e5c14-fec7-49f2-a7ab-46db148340b4 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:06.518442 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c83e5c14-fec7-49f2-a7ab-46db148340b4 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:06.519035 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c83e5c14-fec7-49f2-a7ab-46db148340b4 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:06.759489 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-c83e5c14-fec7-49f2-a7ab-46db148340b4 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:06.769080 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-c83e5c14-fec7-49f2-a7ab-46db148340b4 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1360 microversion: 2.1 time: 0.282246 Jun 07 22:04:06.770254 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 88/158] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:06 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1360 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:07.146410 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-ad154883-f182-41ba-81fc-663069c65ccb tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:07.147015 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-ad154883-f182-41ba-81fc-663069c65ccb tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 5704eeef-7ef8-4e6d-b39d-d672e9592836] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:07.155692 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-ad154883-f182-41ba-81fc-663069c65ccb tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:07.156338 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-ad154883-f182-41ba-81fc-663069c65ccb tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:07.157415 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-ad154883-f182-41ba-81fc-663069c65ccb tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:07.158739 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-ad154883-f182-41ba-81fc-663069c65ccb tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:07.314863 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-ad154883-f182-41ba-81fc-663069c65ccb tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:07.328475 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-ad154883-f182-41ba-81fc-663069c65ccb tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836" status: 200 len: 1368 microversion: 2.1 time: 0.185407 Jun 07 22:04:07.330437 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 71/159] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:07 2022] GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836 => generated 1368 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:07.489339 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-afd37453-0704-40d8-856e-1b534cdd2dba tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:07.490093 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-afd37453-0704-40d8-856e-1b534cdd2dba tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:07.498289 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-afd37453-0704-40d8-856e-1b534cdd2dba tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:07.498740 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-afd37453-0704-40d8-856e-1b534cdd2dba tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:07.499720 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-afd37453-0704-40d8-856e-1b534cdd2dba tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:07.500168 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-afd37453-0704-40d8-856e-1b534cdd2dba tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:07.722364 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-afd37453-0704-40d8-856e-1b534cdd2dba tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:07.731482 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-afd37453-0704-40d8-856e-1b534cdd2dba tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1321 microversion: 2.1 time: 0.246920 Jun 07 22:04:07.732069 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 89/160] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:07 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1321 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:04:07.786042 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-dc37f5cd-45a3-408e-8bd1-db9e70e3f91c tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:07.786859 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-dc37f5cd-45a3-408e-8bd1-db9e70e3f91c tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:07.798688 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-dc37f5cd-45a3-408e-8bd1-db9e70e3f91c tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:07.799315 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-dc37f5cd-45a3-408e-8bd1-db9e70e3f91c tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:07.800304 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-dc37f5cd-45a3-408e-8bd1-db9e70e3f91c tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:07.800899 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-dc37f5cd-45a3-408e-8bd1-db9e70e3f91c tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:07.994748 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-dc37f5cd-45a3-408e-8bd1-db9e70e3f91c tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:08.008455 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-dc37f5cd-45a3-408e-8bd1-db9e70e3f91c tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1360 microversion: 2.1 time: 0.226201 Jun 07 22:04:08.009044 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 72/161] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:07 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1360 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:08.346297 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-28946138-693d-4c82-be54-364684e8a8d2 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:08.347088 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-28946138-693d-4c82-be54-364684e8a8d2 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 5704eeef-7ef8-4e6d-b39d-d672e9592836] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:08.356867 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-28946138-693d-4c82-be54-364684e8a8d2 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:08.357464 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-28946138-693d-4c82-be54-364684e8a8d2 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:08.358369 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-28946138-693d-4c82-be54-364684e8a8d2 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:08.358891 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-28946138-693d-4c82-be54-364684e8a8d2 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:08.596688 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-28946138-693d-4c82-be54-364684e8a8d2 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:08.614385 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-28946138-693d-4c82-be54-364684e8a8d2 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836" status: 200 len: 1368 microversion: 2.1 time: 0.271928 Jun 07 22:04:08.615930 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 90/162] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:08 2022] GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836 => generated 1368 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:08.724908 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [req-2ae4e0ad-c527-47d7-b2cd-da2d65d5dd11 req-3bf1580b-4234-4ccf-8c3d-376c46ca87cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73af9eba-632b-4035-a6ad-02f4fa11866a", "name": "network-vif-plugged", "status": "completed", "tag": "7d1a50e0-bf7e-4a2c-a985-08a1f47ed1d2"}]} {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:04:08.741948 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [req-2ae4e0ad-c527-47d7-b2cd-da2d65d5dd11 req-3bf1580b-4234-4ccf-8c3d-376c46ca87cb service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:08.742659 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [req-2ae4e0ad-c527-47d7-b2cd-da2d65d5dd11 req-3bf1580b-4234-4ccf-8c3d-376c46ca87cb service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:08.749133 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-6e21e989-f708-4424-a635-0e4c0c2b791b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:08.749960 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-6e21e989-f708-4424-a635-0e4c0c2b791b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:08.762805 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-6e21e989-f708-4424-a635-0e4c0c2b791b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:08.763136 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-6e21e989-f708-4424-a635-0e4c0c2b791b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:08.766211 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-6e21e989-f708-4424-a635-0e4c0c2b791b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:08.766800 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-6e21e989-f708-4424-a635-0e4c0c2b791b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:08.787699 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.compute.server_external_events [req-2ae4e0ad-c527-47d7-b2cd-da2d65d5dd11 req-3bf1580b-4234-4ccf-8c3d-376c46ca87cb service nova] Creating event network-vif-plugged:7d1a50e0-bf7e-4a2c-a985-08a1f47ed1d2 for instance 73af9eba-632b-4035-a6ad-02f4fa11866a on hv-cinder-83552 Jun 07 22:04:08.794447 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [req-2ae4e0ad-c527-47d7-b2cd-da2d65d5dd11 req-3bf1580b-4234-4ccf-8c3d-376c46ca87cb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076592 Jun 07 22:04:08.795548 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 73/163] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:04:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:04:08.919157 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-6e21e989-f708-4424-a635-0e4c0c2b791b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:08.927731 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-6e21e989-f708-4424-a635-0e4c0c2b791b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1321 microversion: 2.1 time: 0.183164 Jun 07 22:04:08.928332 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 91/164] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:08 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1321 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:04:09.026931 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-c4eb6bc8-d1f1-4edd-839b-c87ea1b948d0 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:09.027809 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-c4eb6bc8-d1f1-4edd-839b-c87ea1b948d0 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:09.034296 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c4eb6bc8-d1f1-4edd-839b-c87ea1b948d0 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:09.034841 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c4eb6bc8-d1f1-4edd-839b-c87ea1b948d0 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:09.035786 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c4eb6bc8-d1f1-4edd-839b-c87ea1b948d0 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:09.036222 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c4eb6bc8-d1f1-4edd-839b-c87ea1b948d0 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:09.227110 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-c4eb6bc8-d1f1-4edd-839b-c87ea1b948d0 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:09.235828 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-c4eb6bc8-d1f1-4edd-839b-c87ea1b948d0 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1360 microversion: 2.1 time: 0.213616 Jun 07 22:04:09.236403 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 74/165] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:09 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1360 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:09.633365 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-b0008cab-ed38-4739-bf30-cc46bd0dbbc4 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:09.634326 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-b0008cab-ed38-4739-bf30-cc46bd0dbbc4 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 5704eeef-7ef8-4e6d-b39d-d672e9592836] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:09.642933 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b0008cab-ed38-4739-bf30-cc46bd0dbbc4 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:09.643632 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b0008cab-ed38-4739-bf30-cc46bd0dbbc4 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:09.644414 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b0008cab-ed38-4739-bf30-cc46bd0dbbc4 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:09.645246 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b0008cab-ed38-4739-bf30-cc46bd0dbbc4 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:09.863569 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-b0008cab-ed38-4739-bf30-cc46bd0dbbc4 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:09.878453 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-b0008cab-ed38-4739-bf30-cc46bd0dbbc4 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836" status: 200 len: 1368 microversion: 2.1 time: 0.249309 Jun 07 22:04:09.879843 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 92/166] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:09 2022] GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836 => generated 1368 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:09.944593 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-a6a321b3-f999-4413-86cd-2a13e9a5df6c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:09.945218 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-a6a321b3-f999-4413-86cd-2a13e9a5df6c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:09.953349 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a6a321b3-f999-4413-86cd-2a13e9a5df6c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:09.954066 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a6a321b3-f999-4413-86cd-2a13e9a5df6c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:09.955068 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a6a321b3-f999-4413-86cd-2a13e9a5df6c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:09.955840 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a6a321b3-f999-4413-86cd-2a13e9a5df6c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:10.128906 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-a6a321b3-f999-4413-86cd-2a13e9a5df6c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:10.141353 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-a6a321b3-f999-4413-86cd-2a13e9a5df6c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1321 microversion: 2.1 time: 0.200407 Jun 07 22:04:10.141935 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 75/167] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:09 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1321 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:10.253819 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-c829adbf-faaf-4bc8-8951-c818a66223a4 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:10.254425 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-c829adbf-faaf-4bc8-8951-c818a66223a4 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:10.261340 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c829adbf-faaf-4bc8-8951-c818a66223a4 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:10.261780 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c829adbf-faaf-4bc8-8951-c818a66223a4 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:10.262531 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c829adbf-faaf-4bc8-8951-c818a66223a4 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:10.262961 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c829adbf-faaf-4bc8-8951-c818a66223a4 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:10.415122 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-c829adbf-faaf-4bc8-8951-c818a66223a4 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:10.423008 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-c829adbf-faaf-4bc8-8951-c818a66223a4 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1360 microversion: 2.1 time: 0.172895 Jun 07 22:04:10.423606 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 93/168] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:10 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1360 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:10.895518 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-09034cad-3eff-47be-bdfe-581f6e516484 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:10.896481 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-09034cad-3eff-47be-bdfe-581f6e516484 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 5704eeef-7ef8-4e6d-b39d-d672e9592836] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:10.903541 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-09034cad-3eff-47be-bdfe-581f6e516484 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:10.904294 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-09034cad-3eff-47be-bdfe-581f6e516484 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:10.905272 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-09034cad-3eff-47be-bdfe-581f6e516484 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:10.905724 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-09034cad-3eff-47be-bdfe-581f6e516484 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:11.156600 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-09034cad-3eff-47be-bdfe-581f6e516484 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:11.161535 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-6da00504-aa51-487c-bb86-2145ab675d0f tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:11.162217 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-6da00504-aa51-487c-bb86-2145ab675d0f tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:11.164680 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-09034cad-3eff-47be-bdfe-581f6e516484 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836" status: 200 len: 1368 microversion: 2.1 time: 0.273055 Jun 07 22:04:11.165525 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 76/169] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:10 2022] GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836 => generated 1368 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:11.170119 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-6da00504-aa51-487c-bb86-2145ab675d0f tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:11.170563 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-6da00504-aa51-487c-bb86-2145ab675d0f tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:11.171338 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-6da00504-aa51-487c-bb86-2145ab675d0f tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:11.171876 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-6da00504-aa51-487c-bb86-2145ab675d0f tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:11.323092 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-6da00504-aa51-487c-bb86-2145ab675d0f tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:11.331290 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-6da00504-aa51-487c-bb86-2145ab675d0f tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1321 microversion: 2.1 time: 0.175592 Jun 07 22:04:11.331889 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 94/170] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:11 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1321 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:04:11.440182 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-c3f7ec0a-18ed-4b09-b8a5-9187f0f9c96e tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:11.440788 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-c3f7ec0a-18ed-4b09-b8a5-9187f0f9c96e tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:11.446676 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c3f7ec0a-18ed-4b09-b8a5-9187f0f9c96e tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:11.447129 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c3f7ec0a-18ed-4b09-b8a5-9187f0f9c96e tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:11.448167 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c3f7ec0a-18ed-4b09-b8a5-9187f0f9c96e tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:11.448610 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c3f7ec0a-18ed-4b09-b8a5-9187f0f9c96e tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:11.589459 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-c3f7ec0a-18ed-4b09-b8a5-9187f0f9c96e tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:11.597523 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-c3f7ec0a-18ed-4b09-b8a5-9187f0f9c96e tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1360 microversion: 2.1 time: 0.161247 Jun 07 22:04:11.598082 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 77/171] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:11 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1360 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:12.182969 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-d7e1e67e-34d3-436a-abff-df83105bcd71 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:12.183614 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-d7e1e67e-34d3-436a-abff-df83105bcd71 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 5704eeef-7ef8-4e6d-b39d-d672e9592836] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:12.190157 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-d7e1e67e-34d3-436a-abff-df83105bcd71 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:12.190609 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-d7e1e67e-34d3-436a-abff-df83105bcd71 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:12.191408 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-d7e1e67e-34d3-436a-abff-df83105bcd71 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:12.191879 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-d7e1e67e-34d3-436a-abff-df83105bcd71 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:12.330980 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-d7e1e67e-34d3-436a-abff-df83105bcd71 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:12.339262 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-d7e1e67e-34d3-436a-abff-df83105bcd71 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836" status: 200 len: 1368 microversion: 2.1 time: 0.160573 Jun 07 22:04:12.340647 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 95/172] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:12 2022] GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836 => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:12.347947 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-562a82ce-907d-4753-beff-c13bfcb0c67d tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:12.348557 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-562a82ce-907d-4753-beff-c13bfcb0c67d tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:12.355345 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-562a82ce-907d-4753-beff-c13bfcb0c67d tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:12.355855 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-562a82ce-907d-4753-beff-c13bfcb0c67d tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:12.356686 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-562a82ce-907d-4753-beff-c13bfcb0c67d tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:12.357191 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-562a82ce-907d-4753-beff-c13bfcb0c67d tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:12.486882 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-562a82ce-907d-4753-beff-c13bfcb0c67d tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:12.495166 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-562a82ce-907d-4753-beff-c13bfcb0c67d tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1321 microversion: 2.1 time: 0.150131 Jun 07 22:04:12.495891 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 78/173] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:12 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:04:12.617647 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-c2c1e23b-b349-4b29-95cd-b9ddf613d08c tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:12.618286 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-c2c1e23b-b349-4b29-95cd-b9ddf613d08c tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:12.625166 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c2c1e23b-b349-4b29-95cd-b9ddf613d08c tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:12.625611 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c2c1e23b-b349-4b29-95cd-b9ddf613d08c tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:12.626374 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c2c1e23b-b349-4b29-95cd-b9ddf613d08c tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:12.626865 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c2c1e23b-b349-4b29-95cd-b9ddf613d08c tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:12.764615 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-c2c1e23b-b349-4b29-95cd-b9ddf613d08c tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:12.772333 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-c2c1e23b-b349-4b29-95cd-b9ddf613d08c tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1360 microversion: 2.1 time: 0.160943 Jun 07 22:04:12.773094 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 96/174] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:12 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1360 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:13.356094 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-2fb7df7a-3953-4bfa-b14a-add6459e2eff tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:13.356700 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-2fb7df7a-3953-4bfa-b14a-add6459e2eff tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 5704eeef-7ef8-4e6d-b39d-d672e9592836] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:13.362945 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-2fb7df7a-3953-4bfa-b14a-add6459e2eff tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:13.363433 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-2fb7df7a-3953-4bfa-b14a-add6459e2eff tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:13.364196 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-2fb7df7a-3953-4bfa-b14a-add6459e2eff tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:13.364626 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-2fb7df7a-3953-4bfa-b14a-add6459e2eff tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:13.492188 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-2fb7df7a-3953-4bfa-b14a-add6459e2eff tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:13.500145 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-2fb7df7a-3953-4bfa-b14a-add6459e2eff tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836" status: 200 len: 1368 microversion: 2.1 time: 0.148512 Jun 07 22:04:13.500717 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 79/175] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:13 2022] GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836 => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:13.511918 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-b548bed6-0d83-4bd3-8ff0-0fa81a80e099 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:13.512519 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-b548bed6-0d83-4bd3-8ff0-0fa81a80e099 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:13.518859 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b548bed6-0d83-4bd3-8ff0-0fa81a80e099 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:13.519303 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b548bed6-0d83-4bd3-8ff0-0fa81a80e099 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:13.520080 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b548bed6-0d83-4bd3-8ff0-0fa81a80e099 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:13.520511 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b548bed6-0d83-4bd3-8ff0-0fa81a80e099 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:13.652308 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-b548bed6-0d83-4bd3-8ff0-0fa81a80e099 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:13.659577 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-b548bed6-0d83-4bd3-8ff0-0fa81a80e099 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1321 microversion: 2.1 time: 0.151503 Jun 07 22:04:13.660143 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 97/176] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:13 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:13.789270 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-aaba12b7-69d0-452a-9cba-a1296735ede0 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:13.789883 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-aaba12b7-69d0-452a-9cba-a1296735ede0 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:13.796913 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-aaba12b7-69d0-452a-9cba-a1296735ede0 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:13.797364 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-aaba12b7-69d0-452a-9cba-a1296735ede0 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:13.798118 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-aaba12b7-69d0-452a-9cba-a1296735ede0 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:13.798952 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-aaba12b7-69d0-452a-9cba-a1296735ede0 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:13.926496 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-aaba12b7-69d0-452a-9cba-a1296735ede0 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:13.934415 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-aaba12b7-69d0-452a-9cba-a1296735ede0 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1360 microversion: 2.1 time: 0.149000 Jun 07 22:04:13.934975 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 80/177] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:13 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1360 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:14.517064 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-4ef52c0d-5b8f-4db5-90f3-49cecf489b88 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:14.517732 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-4ef52c0d-5b8f-4db5-90f3-49cecf489b88 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 5704eeef-7ef8-4e6d-b39d-d672e9592836] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:14.524151 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-4ef52c0d-5b8f-4db5-90f3-49cecf489b88 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:14.524588 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-4ef52c0d-5b8f-4db5-90f3-49cecf489b88 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:14.525387 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-4ef52c0d-5b8f-4db5-90f3-49cecf489b88 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:14.525960 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-4ef52c0d-5b8f-4db5-90f3-49cecf489b88 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:14.652770 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-4ef52c0d-5b8f-4db5-90f3-49cecf489b88 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:14.660020 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-4ef52c0d-5b8f-4db5-90f3-49cecf489b88 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836" status: 200 len: 1368 microversion: 2.1 time: 0.146797 Jun 07 22:04:14.660589 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 98/178] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:14 2022] GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836 => generated 1368 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:14.676523 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-0ef7a36b-fb49-4a98-9c39-3825b74b87d1 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:14.677135 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-0ef7a36b-fb49-4a98-9c39-3825b74b87d1 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:14.683773 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0ef7a36b-fb49-4a98-9c39-3825b74b87d1 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:14.684271 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0ef7a36b-fb49-4a98-9c39-3825b74b87d1 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:14.685004 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0ef7a36b-fb49-4a98-9c39-3825b74b87d1 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:14.685439 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0ef7a36b-fb49-4a98-9c39-3825b74b87d1 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:14.816945 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-0ef7a36b-fb49-4a98-9c39-3825b74b87d1 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:14.824467 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-0ef7a36b-fb49-4a98-9c39-3825b74b87d1 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1321 microversion: 2.1 time: 0.151689 Jun 07 22:04:14.825031 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 81/179] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:14 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:14.951188 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-87ce75f2-65fc-4ac6-88d1-22682e78b3b6 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:14.951842 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-87ce75f2-65fc-4ac6-88d1-22682e78b3b6 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:14.957821 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-87ce75f2-65fc-4ac6-88d1-22682e78b3b6 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:14.958264 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-87ce75f2-65fc-4ac6-88d1-22682e78b3b6 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:14.959012 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-87ce75f2-65fc-4ac6-88d1-22682e78b3b6 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:14.959483 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-87ce75f2-65fc-4ac6-88d1-22682e78b3b6 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:15.087606 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-87ce75f2-65fc-4ac6-88d1-22682e78b3b6 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:15.095114 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-87ce75f2-65fc-4ac6-88d1-22682e78b3b6 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1360 microversion: 2.1 time: 0.147948 Jun 07 22:04:15.095717 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 99/180] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:14 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1360 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:15.675938 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-cd913ed1-a0e1-4894-b0ba-e8b05be5ec81 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:15.676497 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-cd913ed1-a0e1-4894-b0ba-e8b05be5ec81 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 5704eeef-7ef8-4e6d-b39d-d672e9592836] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:15.682778 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-cd913ed1-a0e1-4894-b0ba-e8b05be5ec81 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:15.683397 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-cd913ed1-a0e1-4894-b0ba-e8b05be5ec81 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:15.683989 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-cd913ed1-a0e1-4894-b0ba-e8b05be5ec81 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:15.684415 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-cd913ed1-a0e1-4894-b0ba-e8b05be5ec81 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:15.820453 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-cd913ed1-a0e1-4894-b0ba-e8b05be5ec81 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:15.828653 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-cd913ed1-a0e1-4894-b0ba-e8b05be5ec81 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836" status: 200 len: 1368 microversion: 2.1 time: 0.156537 Jun 07 22:04:15.829416 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 82/181] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:15 2022] GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836 => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:15.841252 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-bd46ac1b-1d9a-47b5-afae-f5139bc25c31 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:15.841922 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-bd46ac1b-1d9a-47b5-afae-f5139bc25c31 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:15.848443 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-bd46ac1b-1d9a-47b5-afae-f5139bc25c31 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:15.848909 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-bd46ac1b-1d9a-47b5-afae-f5139bc25c31 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:15.849865 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-bd46ac1b-1d9a-47b5-afae-f5139bc25c31 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:15.850312 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-bd46ac1b-1d9a-47b5-afae-f5139bc25c31 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:15.982209 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-bd46ac1b-1d9a-47b5-afae-f5139bc25c31 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:15.989597 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-bd46ac1b-1d9a-47b5-afae-f5139bc25c31 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1321 microversion: 2.1 time: 0.153044 Jun 07 22:04:15.990157 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 100/182] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:15 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:16.115420 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-e9bd0a19-2990-481f-859f-dc6c6a26f40c tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:16.116072 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-e9bd0a19-2990-481f-859f-dc6c6a26f40c tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:16.122876 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e9bd0a19-2990-481f-859f-dc6c6a26f40c tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:16.123453 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e9bd0a19-2990-481f-859f-dc6c6a26f40c tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:16.124520 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e9bd0a19-2990-481f-859f-dc6c6a26f40c tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:16.125125 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e9bd0a19-2990-481f-859f-dc6c6a26f40c tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:16.130584 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_cell1:SELECT=100 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:04:16.262693 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-e9bd0a19-2990-481f-859f-dc6c6a26f40c tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:16.270526 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-e9bd0a19-2990-481f-859f-dc6c6a26f40c tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1360 microversion: 2.1 time: 0.160791 Jun 07 22:04:16.271145 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 83/183] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:16 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1360 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:16.845482 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-de127fda-a22b-4417-811a-5c21ad8145f9 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:16.846355 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-de127fda-a22b-4417-811a-5c21ad8145f9 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 5704eeef-7ef8-4e6d-b39d-d672e9592836] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:16.853275 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-de127fda-a22b-4417-811a-5c21ad8145f9 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:16.854521 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-de127fda-a22b-4417-811a-5c21ad8145f9 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:16.855278 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-de127fda-a22b-4417-811a-5c21ad8145f9 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:16.855742 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-de127fda-a22b-4417-811a-5c21ad8145f9 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:16.880888 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-dc85a769-014c-4cbd-95e0-0b7175e3451b tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-534618867", "imageRef": "87e2e140-6de8-4531-9681-d0a3e069622d", "flavorRef": "452", "networks": [{"uuid": "237bd539-264c-42b8-aec5-0f36574ea98d"}]}} {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:04:16.933919 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.network.neutron [None req-dc85a769-014c-4cbd-95e0-0b7175e3451b tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] validate_networks() for [('237bd539-264c-42b8-aec5-0f36574ea98d', None, None, None, None, None)] {{(pid=117970) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 22:04:17.006058 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-de127fda-a22b-4417-811a-5c21ad8145f9 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:17.014394 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-de127fda-a22b-4417-811a-5c21ad8145f9 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836" status: 200 len: 1368 microversion: 2.1 time: 0.172922 Jun 07 22:04:17.015192 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 101/184] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:16 2022] GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836 => generated 1368 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:17.020257 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-17575f31-788a-4401-9054-8c623f896dce tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:17.021006 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-17575f31-788a-4401-9054-8c623f896dce tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:17.027870 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-17575f31-788a-4401-9054-8c623f896dce tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:17.028314 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-17575f31-788a-4401-9054-8c623f896dce tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:17.029069 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-17575f31-788a-4401-9054-8c623f896dce tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:17.029495 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-17575f31-788a-4401-9054-8c623f896dce tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:17.209441 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-17575f31-788a-4401-9054-8c623f896dce tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:17.218304 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-17575f31-788a-4401-9054-8c623f896dce tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1321 microversion: 2.1 time: 0.201617 Jun 07 22:04:17.218978 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 102/185] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:17 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1321 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:17.287730 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-9c1f7bdc-af13-40e0-b8da-b8401bfb718a tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:17.288345 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-9c1f7bdc-af13-40e0-b8da-b8401bfb718a tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:17.295186 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-9c1f7bdc-af13-40e0-b8da-b8401bfb718a tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:17.295666 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-9c1f7bdc-af13-40e0-b8da-b8401bfb718a tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:17.296438 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-9c1f7bdc-af13-40e0-b8da-b8401bfb718a tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:17.296880 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-9c1f7bdc-af13-40e0-b8da-b8401bfb718a tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:17.315636 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:04:17.441989 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-9c1f7bdc-af13-40e0-b8da-b8401bfb718a tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:17.455713 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-9c1f7bdc-af13-40e0-b8da-b8401bfb718a tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1360 microversion: 2.1 time: 0.171402 Jun 07 22:04:17.457083 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 103/186] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:17 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1360 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:04:17.733764 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.virt.hardware [None req-dc85a769-014c-4cbd-95e0-0b7175e3451b tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Flavor limits 0:0:0 {{(pid=117970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 22:04:17.734180 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.virt.hardware [None req-dc85a769-014c-4cbd-95e0-0b7175e3451b tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Image limits 0:0:0 {{(pid=117970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 22:04:17.735050 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.virt.hardware [None req-dc85a769-014c-4cbd-95e0-0b7175e3451b tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Flavor pref 0:0:0 {{(pid=117970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 22:04:17.735642 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.virt.hardware [None req-dc85a769-014c-4cbd-95e0-0b7175e3451b tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Image pref 0:0:0 {{(pid=117970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 22:04:17.736094 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.virt.hardware [None req-dc85a769-014c-4cbd-95e0-0b7175e3451b tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 22:04:17.747586 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-dc85a769-014c-4cbd-95e0-0b7175e3451b tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:17.748251 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-dc85a769-014c-4cbd-95e0-0b7175e3451b tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:17.749070 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-dc85a769-014c-4cbd-95e0-0b7175e3451b tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:17.749670 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-dc85a769-014c-4cbd-95e0-0b7175e3451b tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:17.781227 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.quota [None req-dc85a769-014c-4cbd-95e0-0b7175e3451b tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Getting quotas for project d3b84dd581fc4e9499cfecbb7242e3b3. Resources: {'cores', 'ram', 'instances'} {{(pid=117970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 22:04:17.785334 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.quota [None req-dc85a769-014c-4cbd-95e0-0b7175e3451b tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Getting quotas for user fa4fc7744b3d4e5fb6e281fcc90cef5e and project d3b84dd581fc4e9499cfecbb7242e3b3. Resources: {'cores', 'ram', 'instances'} {{(pid=117970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 22:04:17.803274 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-dc85a769-014c-4cbd-95e0-0b7175e3451b tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Going to run 1 instances... {{(pid=117970) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 22:04:17.805561 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-dc85a769-014c-4cbd-95e0-0b7175e3451b tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] [instance: 8f7f3be8-21d5-446e-9ee5-0caa7c97a68a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='87e2e140-6de8-4531-9681-d0a3e069622d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 22:04:17.857316 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-dc85a769-014c-4cbd-95e0-0b7175e3451b tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.979987 Jun 07 22:04:17.858071 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 84/187] 10.222.0.13 () {60 vars in 1146 bytes} [Tue Jun 7 22:04:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 982 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 07 22:04:17.868410 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-c912fd8e-a82b-4b27-9915-833168bd3dd0 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:17.870335 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-c912fd8e-a82b-4b27-9915-833168bd3dd0 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] [instance: 8f7f3be8-21d5-446e-9ee5-0caa7c97a68a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:17.929976 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-c912fd8e-a82b-4b27-9915-833168bd3dd0 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4fc7744b3d4e5fb6e281fcc90cef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b84dd581fc4e9499cfecbb7242e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:17.938946 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-c912fd8e-a82b-4b27-9915-833168bd3dd0 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] 10.222.0.13 "GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a" status: 200 len: 1218 microversion: 2.1 time: 0.074884 Jun 07 22:04:17.940108 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 104/188] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:17 2022] GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a => generated 1218 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:18.031299 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-ab9f97a3-cd27-4165-b1eb-0e9223c64e20 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:18.031941 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-ab9f97a3-cd27-4165-b1eb-0e9223c64e20 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 5704eeef-7ef8-4e6d-b39d-d672e9592836] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:18.039378 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-ab9f97a3-cd27-4165-b1eb-0e9223c64e20 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:18.039870 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-ab9f97a3-cd27-4165-b1eb-0e9223c64e20 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:18.040634 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-ab9f97a3-cd27-4165-b1eb-0e9223c64e20 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:18.042199 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-ab9f97a3-cd27-4165-b1eb-0e9223c64e20 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:18.065860 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [req-52624220-24b9-437f-90f0-e3e8974246b5 req-0f08539f-c2fb-44ff-996e-793c1bc5714b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5704eeef-7ef8-4e6d-b39d-d672e9592836", "name": "network-vif-plugged", "status": "completed", "tag": "f75804a7-9ce5-44ca-82e4-e1f8a373373a"}]} {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:04:18.079008 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-52624220-24b9-437f-90f0-e3e8974246b5 req-0f08539f-c2fb-44ff-996e-793c1bc5714b service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:18.079478 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-52624220-24b9-437f-90f0-e3e8974246b5 req-0f08539f-c2fb-44ff-996e-793c1bc5714b service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:18.095802 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.compute.server_external_events [req-52624220-24b9-437f-90f0-e3e8974246b5 req-0f08539f-c2fb-44ff-996e-793c1bc5714b service nova] Creating event network-vif-plugged:f75804a7-9ce5-44ca-82e4-e1f8a373373a for instance 5704eeef-7ef8-4e6d-b39d-d672e9592836 on hv-cinder-83552 Jun 07 22:04:18.104298 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [req-52624220-24b9-437f-90f0-e3e8974246b5 req-0f08539f-c2fb-44ff-996e-793c1bc5714b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044068 Jun 07 22:04:18.105067 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 105/189] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:04:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 22:04:18.210465 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-ab9f97a3-cd27-4165-b1eb-0e9223c64e20 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:18.229239 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-ab9f97a3-cd27-4165-b1eb-0e9223c64e20 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836" status: 200 len: 1368 microversion: 2.1 time: 0.201019 Jun 07 22:04:18.230503 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 85/190] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:18 2022] GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836 => generated 1368 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:18.240746 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-b3165a17-bc90-4d37-8bbe-cb5314196a14 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:18.242761 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-b3165a17-bc90-4d37-8bbe-cb5314196a14 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:18.252259 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b3165a17-bc90-4d37-8bbe-cb5314196a14 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:18.252840 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b3165a17-bc90-4d37-8bbe-cb5314196a14 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:18.254013 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b3165a17-bc90-4d37-8bbe-cb5314196a14 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:18.255186 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b3165a17-bc90-4d37-8bbe-cb5314196a14 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:18.402770 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-b3165a17-bc90-4d37-8bbe-cb5314196a14 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:18.410214 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-b3165a17-bc90-4d37-8bbe-cb5314196a14 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1321 microversion: 2.1 time: 0.176277 Jun 07 22:04:18.410787 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 106/191] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:18 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1321 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:18.474038 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-88e60b49-471a-493d-80b6-795ad9d038a6 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:18.474648 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-88e60b49-471a-493d-80b6-795ad9d038a6 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:18.481838 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-88e60b49-471a-493d-80b6-795ad9d038a6 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:18.482284 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-88e60b49-471a-493d-80b6-795ad9d038a6 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:18.483037 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-88e60b49-471a-493d-80b6-795ad9d038a6 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:18.483521 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-88e60b49-471a-493d-80b6-795ad9d038a6 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:18.612857 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-88e60b49-471a-493d-80b6-795ad9d038a6 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:18.620486 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-88e60b49-471a-493d-80b6-795ad9d038a6 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1360 microversion: 2.1 time: 0.150680 Jun 07 22:04:18.621046 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 86/192] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:18 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1360 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:18.956375 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-19f43523-824c-470b-875f-5f6b53f73e16 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:18.956972 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-19f43523-824c-470b-875f-5f6b53f73e16 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] [instance: 8f7f3be8-21d5-446e-9ee5-0caa7c97a68a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:18.963667 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-19f43523-824c-470b-875f-5f6b53f73e16 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:18.964111 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-19f43523-824c-470b-875f-5f6b53f73e16 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:18.964858 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-19f43523-824c-470b-875f-5f6b53f73e16 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:18.965284 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-19f43523-824c-470b-875f-5f6b53f73e16 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:19.025957 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-19f43523-824c-470b-875f-5f6b53f73e16 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4fc7744b3d4e5fb6e281fcc90cef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b84dd581fc4e9499cfecbb7242e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:19.033509 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-19f43523-824c-470b-875f-5f6b53f73e16 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] 10.222.0.13 "GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a" status: 200 len: 1222 microversion: 2.1 time: 0.080962 Jun 07 22:04:19.034070 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 107/193] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:18 2022] GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a => generated 1222 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:19.247076 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-d4d93ef8-0863-4ea0-9f17-bcece2a52ebe tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:19.247648 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-d4d93ef8-0863-4ea0-9f17-bcece2a52ebe tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 5704eeef-7ef8-4e6d-b39d-d672e9592836] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:19.253696 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d4d93ef8-0863-4ea0-9f17-bcece2a52ebe tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:19.254134 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d4d93ef8-0863-4ea0-9f17-bcece2a52ebe tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:19.254879 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d4d93ef8-0863-4ea0-9f17-bcece2a52ebe tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:19.255308 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d4d93ef8-0863-4ea0-9f17-bcece2a52ebe tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:19.385018 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-d4d93ef8-0863-4ea0-9f17-bcece2a52ebe tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:19.392474 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-d4d93ef8-0863-4ea0-9f17-bcece2a52ebe tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836" status: 200 len: 1368 microversion: 2.1 time: 0.149926 Jun 07 22:04:19.393040 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 87/194] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:19 2022] GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836 => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:19.427199 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-7a4f665c-6f34-4bf4-963b-1d7ce43f3513 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:19.427834 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-7a4f665c-6f34-4bf4-963b-1d7ce43f3513 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:19.434511 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-7a4f665c-6f34-4bf4-963b-1d7ce43f3513 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:19.434953 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-7a4f665c-6f34-4bf4-963b-1d7ce43f3513 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:19.435737 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-7a4f665c-6f34-4bf4-963b-1d7ce43f3513 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:19.436169 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-7a4f665c-6f34-4bf4-963b-1d7ce43f3513 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:19.560651 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-7a4f665c-6f34-4bf4-963b-1d7ce43f3513 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:19.568010 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-7a4f665c-6f34-4bf4-963b-1d7ce43f3513 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1321 microversion: 2.1 time: 0.144629 Jun 07 22:04:19.568590 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 108/195] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:19 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1321 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:19.636900 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-33544774-b9ed-44d3-8cf0-fefddd4ca6e1 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:19.637495 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-33544774-b9ed-44d3-8cf0-fefddd4ca6e1 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:19.643446 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-33544774-b9ed-44d3-8cf0-fefddd4ca6e1 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:19.643885 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-33544774-b9ed-44d3-8cf0-fefddd4ca6e1 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:19.644622 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-33544774-b9ed-44d3-8cf0-fefddd4ca6e1 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:19.645047 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-33544774-b9ed-44d3-8cf0-fefddd4ca6e1 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:19.780068 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-33544774-b9ed-44d3-8cf0-fefddd4ca6e1 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:19.787347 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-33544774-b9ed-44d3-8cf0-fefddd4ca6e1 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1360 microversion: 2.1 time: 0.154677 Jun 07 22:04:19.787890 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 88/196] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:19 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1360 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:20.049929 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-44b658a6-0268-4425-bcbf-9dc2a45705a2 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:20.050531 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-44b658a6-0268-4425-bcbf-9dc2a45705a2 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] [instance: 8f7f3be8-21d5-446e-9ee5-0caa7c97a68a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:20.057213 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-44b658a6-0268-4425-bcbf-9dc2a45705a2 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:20.057654 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-44b658a6-0268-4425-bcbf-9dc2a45705a2 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:20.058395 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-44b658a6-0268-4425-bcbf-9dc2a45705a2 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:20.058820 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-44b658a6-0268-4425-bcbf-9dc2a45705a2 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:20.122137 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-44b658a6-0268-4425-bcbf-9dc2a45705a2 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4fc7744b3d4e5fb6e281fcc90cef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b84dd581fc4e9499cfecbb7242e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:20.129489 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-44b658a6-0268-4425-bcbf-9dc2a45705a2 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] 10.222.0.13 "GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a" status: 200 len: 1222 microversion: 2.1 time: 0.083396 Jun 07 22:04:20.130054 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 109/197] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:20 2022] GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:20.408933 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-9e577d34-2a51-4230-a6cd-51c261f04a4c tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:20.409539 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-9e577d34-2a51-4230-a6cd-51c261f04a4c tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 5704eeef-7ef8-4e6d-b39d-d672e9592836] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:20.415543 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-9e577d34-2a51-4230-a6cd-51c261f04a4c tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:20.415982 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-9e577d34-2a51-4230-a6cd-51c261f04a4c tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:20.416721 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-9e577d34-2a51-4230-a6cd-51c261f04a4c tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:20.417148 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-9e577d34-2a51-4230-a6cd-51c261f04a4c tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:20.555646 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-9e577d34-2a51-4230-a6cd-51c261f04a4c tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:20.564016 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-9e577d34-2a51-4230-a6cd-51c261f04a4c tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836" status: 200 len: 1368 microversion: 2.1 time: 0.158904 Jun 07 22:04:20.564583 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 89/198] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:20 2022] GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836 => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:20.584882 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-de3d7d44-840b-4540-9063-9c497c18ea30 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:20.585481 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-de3d7d44-840b-4540-9063-9c497c18ea30 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:20.591895 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-de3d7d44-840b-4540-9063-9c497c18ea30 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:20.592257 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-de3d7d44-840b-4540-9063-9c497c18ea30 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:20.593005 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-de3d7d44-840b-4540-9063-9c497c18ea30 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:20.593431 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-de3d7d44-840b-4540-9063-9c497c18ea30 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:20.723629 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-de3d7d44-840b-4540-9063-9c497c18ea30 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:20.731561 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-de3d7d44-840b-4540-9063-9c497c18ea30 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1321 microversion: 2.1 time: 0.150346 Jun 07 22:04:20.732150 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 110/199] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:20 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:20.813509 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-7515f5bf-31f2-42d6-91c4-e19fc021079b tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:20.814119 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-7515f5bf-31f2-42d6-91c4-e19fc021079b tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:20.821128 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-7515f5bf-31f2-42d6-91c4-e19fc021079b tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:20.821634 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-7515f5bf-31f2-42d6-91c4-e19fc021079b tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:20.823056 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-7515f5bf-31f2-42d6-91c4-e19fc021079b tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:20.823475 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-7515f5bf-31f2-42d6-91c4-e19fc021079b tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:20.966546 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-7515f5bf-31f2-42d6-91c4-e19fc021079b tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:20.974308 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-7515f5bf-31f2-42d6-91c4-e19fc021079b tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1360 microversion: 2.1 time: 0.164577 Jun 07 22:04:20.974894 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 90/200] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:20 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1360 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:21.146997 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-a1e3cfa5-19d6-4593-b323-6a7cea8b0667 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:21.147679 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-a1e3cfa5-19d6-4593-b323-6a7cea8b0667 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] [instance: 8f7f3be8-21d5-446e-9ee5-0caa7c97a68a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:21.155005 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a1e3cfa5-19d6-4593-b323-6a7cea8b0667 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:21.155397 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a1e3cfa5-19d6-4593-b323-6a7cea8b0667 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:21.156156 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a1e3cfa5-19d6-4593-b323-6a7cea8b0667 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:21.156593 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a1e3cfa5-19d6-4593-b323-6a7cea8b0667 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:21.217817 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-a1e3cfa5-19d6-4593-b323-6a7cea8b0667 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4fc7744b3d4e5fb6e281fcc90cef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b84dd581fc4e9499cfecbb7242e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:21.225228 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-a1e3cfa5-19d6-4593-b323-6a7cea8b0667 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] 10.222.0.13 "GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a" status: 200 len: 1222 microversion: 2.1 time: 0.082079 Jun 07 22:04:21.226044 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 111/201] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:21 2022] GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a => generated 1222 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:21.582486 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-81e64f9d-8ec4-48ac-ae3a-f4bde297a929 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:21.583115 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-81e64f9d-8ec4-48ac-ae3a-f4bde297a929 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 5704eeef-7ef8-4e6d-b39d-d672e9592836] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:21.590320 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-81e64f9d-8ec4-48ac-ae3a-f4bde297a929 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:21.590763 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-81e64f9d-8ec4-48ac-ae3a-f4bde297a929 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:21.591674 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-81e64f9d-8ec4-48ac-ae3a-f4bde297a929 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:21.592212 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-81e64f9d-8ec4-48ac-ae3a-f4bde297a929 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:21.733404 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-81e64f9d-8ec4-48ac-ae3a-f4bde297a929 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:21.741294 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-81e64f9d-8ec4-48ac-ae3a-f4bde297a929 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836" status: 200 len: 1368 microversion: 2.1 time: 0.162720 Jun 07 22:04:21.741869 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 91/202] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:21 2022] GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836 => generated 1368 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:21.748019 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-e3c48466-445d-4077-8a17-6198005f4f2f tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:21.748625 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-e3c48466-445d-4077-8a17-6198005f4f2f tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:21.756933 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e3c48466-445d-4077-8a17-6198005f4f2f tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:21.757382 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e3c48466-445d-4077-8a17-6198005f4f2f tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:21.758157 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e3c48466-445d-4077-8a17-6198005f4f2f tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:21.758592 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e3c48466-445d-4077-8a17-6198005f4f2f tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:21.902244 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-e3c48466-445d-4077-8a17-6198005f4f2f tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:21.911094 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-e3c48466-445d-4077-8a17-6198005f4f2f tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1321 microversion: 2.1 time: 0.166889 Jun 07 22:04:21.911715 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 112/203] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:21 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:21.992502 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-9f679786-e5ad-4227-86c4-d4110bae461d tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:21.993023 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-9f679786-e5ad-4227-86c4-d4110bae461d tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:21.999784 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-9f679786-e5ad-4227-86c4-d4110bae461d tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:22.000235 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-9f679786-e5ad-4227-86c4-d4110bae461d tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:22.000998 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-9f679786-e5ad-4227-86c4-d4110bae461d tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:22.001503 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-9f679786-e5ad-4227-86c4-d4110bae461d tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:22.140391 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-9f679786-e5ad-4227-86c4-d4110bae461d tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:22.148045 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-9f679786-e5ad-4227-86c4-d4110bae461d tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1360 microversion: 2.1 time: 0.159586 Jun 07 22:04:22.148614 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 92/204] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:21 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1360 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:22.242916 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-ba1a5663-0b79-45aa-a936-e5284aaa8b77 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:22.243707 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-ba1a5663-0b79-45aa-a936-e5284aaa8b77 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] [instance: 8f7f3be8-21d5-446e-9ee5-0caa7c97a68a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:22.250582 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ba1a5663-0b79-45aa-a936-e5284aaa8b77 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:22.251023 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ba1a5663-0b79-45aa-a936-e5284aaa8b77 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:22.251814 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ba1a5663-0b79-45aa-a936-e5284aaa8b77 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:22.252241 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ba1a5663-0b79-45aa-a936-e5284aaa8b77 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:22.314012 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-ba1a5663-0b79-45aa-a936-e5284aaa8b77 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4fc7744b3d4e5fb6e281fcc90cef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b84dd581fc4e9499cfecbb7242e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:22.321775 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-ba1a5663-0b79-45aa-a936-e5284aaa8b77 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] 10.222.0.13 "GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a" status: 200 len: 1222 microversion: 2.1 time: 0.082694 Jun 07 22:04:22.322948 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 113/205] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:22 2022] GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:22.758925 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-3536a69e-3eba-4bfa-b6ad-84f14a53e352 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:22.760330 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-3536a69e-3eba-4bfa-b6ad-84f14a53e352 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 5704eeef-7ef8-4e6d-b39d-d672e9592836] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:22.766358 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-3536a69e-3eba-4bfa-b6ad-84f14a53e352 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:22.766801 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-3536a69e-3eba-4bfa-b6ad-84f14a53e352 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:22.767577 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-3536a69e-3eba-4bfa-b6ad-84f14a53e352 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:22.768006 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-3536a69e-3eba-4bfa-b6ad-84f14a53e352 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:22.896322 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-3536a69e-3eba-4bfa-b6ad-84f14a53e352 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:22.907316 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-3536a69e-3eba-4bfa-b6ad-84f14a53e352 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836" status: 200 len: 1368 microversion: 2.1 time: 0.152200 Jun 07 22:04:22.908152 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 93/206] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:22 2022] GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:22.928090 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-645af932-0e71-48bb-953b-1c46ef5f30f3 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:22.928688 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-645af932-0e71-48bb-953b-1c46ef5f30f3 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:22.935185 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-645af932-0e71-48bb-953b-1c46ef5f30f3 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:22.935656 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-645af932-0e71-48bb-953b-1c46ef5f30f3 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:22.936408 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-645af932-0e71-48bb-953b-1c46ef5f30f3 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:22.936915 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-645af932-0e71-48bb-953b-1c46ef5f30f3 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:23.067446 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-645af932-0e71-48bb-953b-1c46ef5f30f3 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:23.076024 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-645af932-0e71-48bb-953b-1c46ef5f30f3 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1321 microversion: 2.1 time: 0.151614 Jun 07 22:04:23.076604 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 114/207] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:22 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:23.165499 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-3c8af220-0756-48ef-b43c-ae08d3a410dd tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:23.166368 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-3c8af220-0756-48ef-b43c-ae08d3a410dd tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:23.172429 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-3c8af220-0756-48ef-b43c-ae08d3a410dd tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:23.172868 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-3c8af220-0756-48ef-b43c-ae08d3a410dd tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:23.173604 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-3c8af220-0756-48ef-b43c-ae08d3a410dd tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:23.174027 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-3c8af220-0756-48ef-b43c-ae08d3a410dd tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:23.304916 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-3c8af220-0756-48ef-b43c-ae08d3a410dd tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:23.313072 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-3c8af220-0756-48ef-b43c-ae08d3a410dd tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1360 microversion: 2.1 time: 0.151465 Jun 07 22:04:23.313636 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 94/208] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:23 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1360 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:23.339698 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-7f6f0373-0026-445c-8d28-f39736899012 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:23.340309 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-7f6f0373-0026-445c-8d28-f39736899012 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] [instance: 8f7f3be8-21d5-446e-9ee5-0caa7c97a68a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:23.346649 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-7f6f0373-0026-445c-8d28-f39736899012 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:23.347092 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-7f6f0373-0026-445c-8d28-f39736899012 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:23.347879 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-7f6f0373-0026-445c-8d28-f39736899012 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:23.348312 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-7f6f0373-0026-445c-8d28-f39736899012 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:23.410662 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-7f6f0373-0026-445c-8d28-f39736899012 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4fc7744b3d4e5fb6e281fcc90cef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b84dd581fc4e9499cfecbb7242e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:23.419129 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-7f6f0373-0026-445c-8d28-f39736899012 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] 10.222.0.13 "GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a" status: 200 len: 1222 microversion: 2.1 time: 0.083378 Jun 07 22:04:23.419732 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 115/209] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:23 2022] GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:23.927532 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-d958e393-6e01-410c-9dd5-3fd1b4ecf5af tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:23.928135 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-d958e393-6e01-410c-9dd5-3fd1b4ecf5af tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 5704eeef-7ef8-4e6d-b39d-d672e9592836] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:23.934217 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d958e393-6e01-410c-9dd5-3fd1b4ecf5af tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:23.934651 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d958e393-6e01-410c-9dd5-3fd1b4ecf5af tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:23.935418 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d958e393-6e01-410c-9dd5-3fd1b4ecf5af tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:23.935844 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d958e393-6e01-410c-9dd5-3fd1b4ecf5af tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:24.073497 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-d958e393-6e01-410c-9dd5-3fd1b4ecf5af tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:24.080822 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-d958e393-6e01-410c-9dd5-3fd1b4ecf5af tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836" status: 200 len: 1368 microversion: 2.1 time: 0.157208 Jun 07 22:04:24.081400 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 95/210] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:23 2022] GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836 => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:24.095679 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-482618f7-d9c9-401d-8d38-3e66d0005eea tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:24.095679 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-482618f7-d9c9-401d-8d38-3e66d0005eea tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:24.100687 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-482618f7-d9c9-401d-8d38-3e66d0005eea tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:24.101380 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-482618f7-d9c9-401d-8d38-3e66d0005eea tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:24.102126 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-482618f7-d9c9-401d-8d38-3e66d0005eea tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:24.102552 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-482618f7-d9c9-401d-8d38-3e66d0005eea tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:24.261955 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-482618f7-d9c9-401d-8d38-3e66d0005eea tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:24.270400 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-482618f7-d9c9-401d-8d38-3e66d0005eea tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1321 microversion: 2.1 time: 0.180971 Jun 07 22:04:24.270960 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 116/211] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:24 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1321 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:24.329819 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-66188669-421a-4dd0-ac9a-489275d5fde4 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:24.330418 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-66188669-421a-4dd0-ac9a-489275d5fde4 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:24.332242 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:04:24.337512 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-66188669-421a-4dd0-ac9a-489275d5fde4 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:24.337981 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-66188669-421a-4dd0-ac9a-489275d5fde4 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:24.338740 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-66188669-421a-4dd0-ac9a-489275d5fde4 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:24.339162 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-66188669-421a-4dd0-ac9a-489275d5fde4 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:24.436289 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-30939f1b-a3ae-4504-9cee-7458bcf4651b tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:24.436896 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-30939f1b-a3ae-4504-9cee-7458bcf4651b tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] [instance: 8f7f3be8-21d5-446e-9ee5-0caa7c97a68a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:24.445251 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-30939f1b-a3ae-4504-9cee-7458bcf4651b tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:24.445702 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-30939f1b-a3ae-4504-9cee-7458bcf4651b tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:24.446462 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-30939f1b-a3ae-4504-9cee-7458bcf4651b tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:24.447521 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-30939f1b-a3ae-4504-9cee-7458bcf4651b tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:24.469166 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-66188669-421a-4dd0-ac9a-489275d5fde4 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:24.476704 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-66188669-421a-4dd0-ac9a-489275d5fde4 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1360 microversion: 2.1 time: 0.150637 Jun 07 22:04:24.487365 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 96/212] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:24 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1360 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:24.512474 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-30939f1b-a3ae-4504-9cee-7458bcf4651b tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4fc7744b3d4e5fb6e281fcc90cef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b84dd581fc4e9499cfecbb7242e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:24.520561 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-30939f1b-a3ae-4504-9cee-7458bcf4651b tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] 10.222.0.13 "GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a" status: 200 len: 1222 microversion: 2.1 time: 0.087938 Jun 07 22:04:24.521150 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 117/213] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:24 2022] GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a => generated 1222 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:04:25.098410 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-832cd3d2-4285-4a5b-88b0-d25ce29cba1b tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:25.099218 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-832cd3d2-4285-4a5b-88b0-d25ce29cba1b tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 5704eeef-7ef8-4e6d-b39d-d672e9592836] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:25.107561 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-832cd3d2-4285-4a5b-88b0-d25ce29cba1b tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:25.108098 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-832cd3d2-4285-4a5b-88b0-d25ce29cba1b tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:25.119964 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-832cd3d2-4285-4a5b-88b0-d25ce29cba1b tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:25.120597 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-832cd3d2-4285-4a5b-88b0-d25ce29cba1b tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:25.280362 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-832cd3d2-4285-4a5b-88b0-d25ce29cba1b tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:25.289223 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-7bd68a43-7c76-4374-8214-e439463e2489 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:25.289429 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-832cd3d2-4285-4a5b-88b0-d25ce29cba1b tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836" status: 200 len: 1368 microversion: 2.1 time: 0.194911 Jun 07 22:04:25.289833 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-7bd68a43-7c76-4374-8214-e439463e2489 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:25.290472 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 97/214] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:25 2022] GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836 => generated 1368 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:25.296892 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-7bd68a43-7c76-4374-8214-e439463e2489 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:25.297332 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-7bd68a43-7c76-4374-8214-e439463e2489 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:25.298097 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-7bd68a43-7c76-4374-8214-e439463e2489 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:25.298543 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-7bd68a43-7c76-4374-8214-e439463e2489 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:25.444578 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-7bd68a43-7c76-4374-8214-e439463e2489 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:25.454666 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-7bd68a43-7c76-4374-8214-e439463e2489 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1321 microversion: 2.1 time: 0.171024 Jun 07 22:04:25.455240 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 118/215] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:25 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1321 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:04:25.495690 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-bde6134b-bda8-4c5b-a706-86a0a8af1b65 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:25.496486 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-bde6134b-bda8-4c5b-a706-86a0a8af1b65 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:25.502441 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-bde6134b-bda8-4c5b-a706-86a0a8af1b65 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:25.502876 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-bde6134b-bda8-4c5b-a706-86a0a8af1b65 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:25.503810 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-bde6134b-bda8-4c5b-a706-86a0a8af1b65 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:25.504262 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-bde6134b-bda8-4c5b-a706-86a0a8af1b65 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:25.541315 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-c21d1f24-2345-419b-a1b2-30da65ffb7ea tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:25.542297 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-c21d1f24-2345-419b-a1b2-30da65ffb7ea tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] [instance: 8f7f3be8-21d5-446e-9ee5-0caa7c97a68a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:25.550291 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c21d1f24-2345-419b-a1b2-30da65ffb7ea tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:25.550822 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c21d1f24-2345-419b-a1b2-30da65ffb7ea tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:25.551688 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c21d1f24-2345-419b-a1b2-30da65ffb7ea tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:25.552250 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c21d1f24-2345-419b-a1b2-30da65ffb7ea tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:25.620947 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-c21d1f24-2345-419b-a1b2-30da65ffb7ea tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4fc7744b3d4e5fb6e281fcc90cef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b84dd581fc4e9499cfecbb7242e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:25.630400 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-c21d1f24-2345-419b-a1b2-30da65ffb7ea tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] 10.222.0.13 "GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a" status: 200 len: 1214 microversion: 2.1 time: 0.096107 Jun 07 22:04:25.631521 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 119/216] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:25 2022] GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a => generated 1214 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:04:25.655594 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-bde6134b-bda8-4c5b-a706-86a0a8af1b65 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:25.663576 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-bde6134b-bda8-4c5b-a706-86a0a8af1b65 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1360 microversion: 2.1 time: 0.172489 Jun 07 22:04:25.664462 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 98/217] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:25 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1360 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:26.307348 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-4b526141-4b10-482a-9ea4-532a2bfb0202 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:26.308184 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-4b526141-4b10-482a-9ea4-532a2bfb0202 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 5704eeef-7ef8-4e6d-b39d-d672e9592836] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:26.314334 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-4b526141-4b10-482a-9ea4-532a2bfb0202 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:26.314772 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-4b526141-4b10-482a-9ea4-532a2bfb0202 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:26.315569 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-4b526141-4b10-482a-9ea4-532a2bfb0202 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:26.315995 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-4b526141-4b10-482a-9ea4-532a2bfb0202 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:26.471291 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-99e5ddfc-17a0-43df-9df6-d55b119bceed tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:26.471919 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-99e5ddfc-17a0-43df-9df6-d55b119bceed tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:26.478117 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-99e5ddfc-17a0-43df-9df6-d55b119bceed tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:26.478564 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-99e5ddfc-17a0-43df-9df6-d55b119bceed tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:26.479448 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-99e5ddfc-17a0-43df-9df6-d55b119bceed tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:26.479877 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-99e5ddfc-17a0-43df-9df6-d55b119bceed tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:26.487556 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-4b526141-4b10-482a-9ea4-532a2bfb0202 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:26.495821 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-4b526141-4b10-482a-9ea4-532a2bfb0202 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836" status: 200 len: 1368 microversion: 2.1 time: 0.192425 Jun 07 22:04:26.496401 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 120/218] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:26 2022] GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836 => generated 1368 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:26.624543 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-99e5ddfc-17a0-43df-9df6-d55b119bceed tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:26.632182 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-99e5ddfc-17a0-43df-9df6-d55b119bceed tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1321 microversion: 2.1 time: 0.164734 Jun 07 22:04:26.632793 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 99/219] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:26 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1321 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:04:26.648473 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-ef8e8677-5369-441d-9508-bed7678a667a tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:26.649086 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-ef8e8677-5369-441d-9508-bed7678a667a tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] [instance: 8f7f3be8-21d5-446e-9ee5-0caa7c97a68a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:26.654997 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ef8e8677-5369-441d-9508-bed7678a667a tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:26.655489 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ef8e8677-5369-441d-9508-bed7678a667a tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:26.656248 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ef8e8677-5369-441d-9508-bed7678a667a tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:26.656683 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ef8e8677-5369-441d-9508-bed7678a667a tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:26.683107 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-825f0b58-66fc-436b-96b4-1fe1d61c4a2c tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:26.684176 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-825f0b58-66fc-436b-96b4-1fe1d61c4a2c tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:26.691449 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-825f0b58-66fc-436b-96b4-1fe1d61c4a2c tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:26.692005 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-825f0b58-66fc-436b-96b4-1fe1d61c4a2c tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:26.692876 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-825f0b58-66fc-436b-96b4-1fe1d61c4a2c tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:26.693419 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-825f0b58-66fc-436b-96b4-1fe1d61c4a2c tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:26.724475 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-ef8e8677-5369-441d-9508-bed7678a667a tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4fc7744b3d4e5fb6e281fcc90cef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b84dd581fc4e9499cfecbb7242e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:26.726471 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_cell1:SELECT=100 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:04:26.732048 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_cell1:SELECT=100 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:04:26.734166 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-ef8e8677-5369-441d-9508-bed7678a667a tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] 10.222.0.13 "GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a" status: 200 len: 1214 microversion: 2.1 time: 0.089803 Jun 07 22:04:26.734737 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 121/220] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:26 2022] GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a => generated 1214 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:26.849564 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-825f0b58-66fc-436b-96b4-1fe1d61c4a2c tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:26.858196 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-825f0b58-66fc-436b-96b4-1fe1d61c4a2c tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1360 microversion: 2.1 time: 0.180959 Jun 07 22:04:26.858974 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 100/221] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:26 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1360 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:04:27.513453 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-da1df089-d9cf-4e8c-aac2-ad38faef4c74 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:27.514166 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-da1df089-d9cf-4e8c-aac2-ad38faef4c74 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 5704eeef-7ef8-4e6d-b39d-d672e9592836] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:27.516677 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_api:SELECT=100 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:04:27.522453 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-da1df089-d9cf-4e8c-aac2-ad38faef4c74 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:27.522901 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-da1df089-d9cf-4e8c-aac2-ad38faef4c74 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:27.523683 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-da1df089-d9cf-4e8c-aac2-ad38faef4c74 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:27.524118 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-da1df089-d9cf-4e8c-aac2-ad38faef4c74 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:27.651947 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-22ef48f7-5383-4fc5-a876-ca2d0f3c5e87 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:27.653816 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-22ef48f7-5383-4fc5-a876-ca2d0f3c5e87 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:27.673507 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-22ef48f7-5383-4fc5-a876-ca2d0f3c5e87 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:27.674328 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-22ef48f7-5383-4fc5-a876-ca2d0f3c5e87 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:27.675159 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-22ef48f7-5383-4fc5-a876-ca2d0f3c5e87 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:27.675682 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-22ef48f7-5383-4fc5-a876-ca2d0f3c5e87 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:27.676218 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-da1df089-d9cf-4e8c-aac2-ad38faef4c74 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:27.685094 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-da1df089-d9cf-4e8c-aac2-ad38faef4c74 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836" status: 200 len: 1368 microversion: 2.1 time: 0.176585 Jun 07 22:04:27.694741 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 122/222] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:27 2022] GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836 => generated 1368 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:27.751122 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-75f4562c-cfa7-4947-9f9a-1e26facbe375 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:27.751766 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-75f4562c-cfa7-4947-9f9a-1e26facbe375 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] [instance: 8f7f3be8-21d5-446e-9ee5-0caa7c97a68a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:27.759032 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-75f4562c-cfa7-4947-9f9a-1e26facbe375 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:27.759032 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-75f4562c-cfa7-4947-9f9a-1e26facbe375 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:27.759917 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-75f4562c-cfa7-4947-9f9a-1e26facbe375 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:27.760369 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-75f4562c-cfa7-4947-9f9a-1e26facbe375 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:27.771437 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_cell0:SELECT=2 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:04:27.796830 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_cell0:SELECT=6 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:04:27.830231 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-75f4562c-cfa7-4947-9f9a-1e26facbe375 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4fc7744b3d4e5fb6e281fcc90cef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b84dd581fc4e9499cfecbb7242e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:27.838883 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-75f4562c-cfa7-4947-9f9a-1e26facbe375 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] 10.222.0.13 "GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a" status: 200 len: 1214 microversion: 2.1 time: 0.092176 Jun 07 22:04:27.839515 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 123/223] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:27 2022] GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a => generated 1214 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:04:27.848597 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-22ef48f7-5383-4fc5-a876-ca2d0f3c5e87 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:27.856290 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-22ef48f7-5383-4fc5-a876-ca2d0f3c5e87 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1321 microversion: 2.1 time: 0.209531 Jun 07 22:04:27.856863 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 101/224] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:27 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1321 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:27.875889 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-a1dd9e76-1106-451e-ba91-a116077cb912 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:27.876524 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-a1dd9e76-1106-451e-ba91-a116077cb912 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:27.882694 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a1dd9e76-1106-451e-ba91-a116077cb912 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:27.883145 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a1dd9e76-1106-451e-ba91-a116077cb912 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:27.883931 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a1dd9e76-1106-451e-ba91-a116077cb912 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:27.885012 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a1dd9e76-1106-451e-ba91-a116077cb912 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:27.936023 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_cell0:SELECT=2 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:04:28.012354 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-a1dd9e76-1106-451e-ba91-a116077cb912 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:28.019767 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-a1dd9e76-1106-451e-ba91-a116077cb912 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1360 microversion: 2.1 time: 0.147730 Jun 07 22:04:28.020340 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 124/225] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:27 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1360 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:28.366591 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [req-c5a4251f-6785-4001-aea6-fb78e605d820 req-7cd81e58-3e6d-4236-8743-52ee66724934 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f29be694-507c-48eb-9fdd-d20bef8f6609", "name": "network-vif-plugged", "status": "completed", "tag": "b5e13943-f98b-44ed-aa48-c5263e7a75d2"}]} {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:04:28.375710 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [req-c5a4251f-6785-4001-aea6-fb78e605d820 req-7cd81e58-3e6d-4236-8743-52ee66724934 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:28.376150 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [req-c5a4251f-6785-4001-aea6-fb78e605d820 req-7cd81e58-3e6d-4236-8743-52ee66724934 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:28.397360 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.compute.server_external_events [req-c5a4251f-6785-4001-aea6-fb78e605d820 req-7cd81e58-3e6d-4236-8743-52ee66724934 service nova] Creating event network-vif-plugged:b5e13943-f98b-44ed-aa48-c5263e7a75d2 for instance f29be694-507c-48eb-9fdd-d20bef8f6609 on hv-cinder-83552 Jun 07 22:04:28.406386 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [req-c5a4251f-6785-4001-aea6-fb78e605d820 req-7cd81e58-3e6d-4236-8743-52ee66724934 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039826 Jun 07 22:04:28.406386 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 102/226] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:04:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:04:28.701941 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-58f8ac02-2ef4-49b9-bd1e-322e28480c10 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:28.702560 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-58f8ac02-2ef4-49b9-bd1e-322e28480c10 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 5704eeef-7ef8-4e6d-b39d-d672e9592836] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:28.709129 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-58f8ac02-2ef4-49b9-bd1e-322e28480c10 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:28.709572 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-58f8ac02-2ef4-49b9-bd1e-322e28480c10 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:28.710324 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-58f8ac02-2ef4-49b9-bd1e-322e28480c10 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:28.710753 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-58f8ac02-2ef4-49b9-bd1e-322e28480c10 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:28.845889 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-58f8ac02-2ef4-49b9-bd1e-322e28480c10 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:28.854389 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-58f8ac02-2ef4-49b9-bd1e-322e28480c10 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836" status: 200 len: 1368 microversion: 2.1 time: 0.156178 Jun 07 22:04:28.855143 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 125/227] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:28 2022] GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836 => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:28.863954 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-520efc83-1588-459e-992e-0896b8d56e90 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:28.863954 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-520efc83-1588-459e-992e-0896b8d56e90 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] [instance: 8f7f3be8-21d5-446e-9ee5-0caa7c97a68a] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:28.864847 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-520efc83-1588-459e-992e-0896b8d56e90 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:28.865298 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-520efc83-1588-459e-992e-0896b8d56e90 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:28.866058 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-520efc83-1588-459e-992e-0896b8d56e90 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:28.866492 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-520efc83-1588-459e-992e-0896b8d56e90 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:28.876754 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-aef8d1b6-dfc8-4f23-a509-a3fd22103dea tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:28.877348 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-aef8d1b6-dfc8-4f23-a509-a3fd22103dea tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:28.883207 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-aef8d1b6-dfc8-4f23-a509-a3fd22103dea tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:28.883690 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-aef8d1b6-dfc8-4f23-a509-a3fd22103dea tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:28.884435 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-aef8d1b6-dfc8-4f23-a509-a3fd22103dea tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:28.885177 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-aef8d1b6-dfc8-4f23-a509-a3fd22103dea tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:28.928216 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-520efc83-1588-459e-992e-0896b8d56e90 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4fc7744b3d4e5fb6e281fcc90cef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b84dd581fc4e9499cfecbb7242e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:28.936444 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-520efc83-1588-459e-992e-0896b8d56e90 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] 10.222.0.13 "GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a" status: 200 len: 1214 microversion: 2.1 time: 0.083745 Jun 07 22:04:28.937020 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 103/228] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:28 2022] GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:04:29.013017 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-aef8d1b6-dfc8-4f23-a509-a3fd22103dea tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:29.020417 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-aef8d1b6-dfc8-4f23-a509-a3fd22103dea tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1321 microversion: 2.1 time: 0.147380 Jun 07 22:04:29.020962 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 126/229] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:28 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1321 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:04:29.036527 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-96e57e54-ed13-4bab-889e-d917318d9488 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:29.037129 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-96e57e54-ed13-4bab-889e-d917318d9488 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:29.043240 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-96e57e54-ed13-4bab-889e-d917318d9488 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:29.043728 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-96e57e54-ed13-4bab-889e-d917318d9488 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:29.044480 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-96e57e54-ed13-4bab-889e-d917318d9488 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:29.044912 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-96e57e54-ed13-4bab-889e-d917318d9488 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:29.177468 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-96e57e54-ed13-4bab-889e-d917318d9488 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:29.184718 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-96e57e54-ed13-4bab-889e-d917318d9488 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1360 microversion: 2.1 time: 0.151991 Jun 07 22:04:29.185279 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 104/230] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:29 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1360 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:29.871672 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-8fdadc8b-7a6c-4bb6-9226-684704be6c78 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:29.872288 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-8fdadc8b-7a6c-4bb6-9226-684704be6c78 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 5704eeef-7ef8-4e6d-b39d-d672e9592836] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:29.879086 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-8fdadc8b-7a6c-4bb6-9226-684704be6c78 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:29.879571 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-8fdadc8b-7a6c-4bb6-9226-684704be6c78 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:29.880366 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-8fdadc8b-7a6c-4bb6-9226-684704be6c78 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:29.880807 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-8fdadc8b-7a6c-4bb6-9226-684704be6c78 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:29.954391 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-1e9fe739-86c1-4250-becb-40a335fd1bba tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:29.955000 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-1e9fe739-86c1-4250-becb-40a335fd1bba tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] [instance: 8f7f3be8-21d5-446e-9ee5-0caa7c97a68a] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:29.960966 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1e9fe739-86c1-4250-becb-40a335fd1bba tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:29.961409 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1e9fe739-86c1-4250-becb-40a335fd1bba tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:29.962355 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1e9fe739-86c1-4250-becb-40a335fd1bba tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:29.962748 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1e9fe739-86c1-4250-becb-40a335fd1bba tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:30.016557 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-8fdadc8b-7a6c-4bb6-9226-684704be6c78 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:30.023240 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-1e9fe739-86c1-4250-becb-40a335fd1bba tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4fc7744b3d4e5fb6e281fcc90cef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b84dd581fc4e9499cfecbb7242e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:30.024372 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-8fdadc8b-7a6c-4bb6-9226-684704be6c78 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836" status: 200 len: 1368 microversion: 2.1 time: 0.157098 Jun 07 22:04:30.024946 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 127/231] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:29 2022] GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836 => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:30.031178 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-1e9fe739-86c1-4250-becb-40a335fd1bba tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] 10.222.0.13 "GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a" status: 200 len: 1214 microversion: 2.1 time: 0.081247 Jun 07 22:04:30.031774 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 105/232] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:29 2022] GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:30.037394 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-a4f1ce16-795a-4ec5-923c-2480647a0552 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:30.037997 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-a4f1ce16-795a-4ec5-923c-2480647a0552 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:30.044662 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a4f1ce16-795a-4ec5-923c-2480647a0552 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:30.045102 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a4f1ce16-795a-4ec5-923c-2480647a0552 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:30.045850 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a4f1ce16-795a-4ec5-923c-2480647a0552 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:30.046301 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a4f1ce16-795a-4ec5-923c-2480647a0552 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:30.173820 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-a4f1ce16-795a-4ec5-923c-2480647a0552 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:30.181245 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-a4f1ce16-795a-4ec5-923c-2480647a0552 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1321 microversion: 2.1 time: 0.147519 Jun 07 22:04:30.181810 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 128/233] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:30 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1321 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:04:30.203008 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-e6c6c18b-c6a1-4064-b74d-9f17a8d9a96d tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:30.203931 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-e6c6c18b-c6a1-4064-b74d-9f17a8d9a96d tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:30.210515 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e6c6c18b-c6a1-4064-b74d-9f17a8d9a96d tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:30.210967 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e6c6c18b-c6a1-4064-b74d-9f17a8d9a96d tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:30.211768 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e6c6c18b-c6a1-4064-b74d-9f17a8d9a96d tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:30.212203 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e6c6c18b-c6a1-4064-b74d-9f17a8d9a96d tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:30.340226 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-e6c6c18b-c6a1-4064-b74d-9f17a8d9a96d tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:30.347501 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-e6c6c18b-c6a1-4064-b74d-9f17a8d9a96d tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1360 microversion: 2.1 time: 0.149971 Jun 07 22:04:30.348119 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 106/234] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:30 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1360 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:31.041560 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-04a35a64-cde8-4390-a2bf-713c0ab080fb tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:31.042167 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-04a35a64-cde8-4390-a2bf-713c0ab080fb tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 5704eeef-7ef8-4e6d-b39d-d672e9592836] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:31.048620 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-a85b0233-7ef2-45dc-8766-12fba2b41db6 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:31.049063 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-04a35a64-cde8-4390-a2bf-713c0ab080fb tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:31.049241 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-a85b0233-7ef2-45dc-8766-12fba2b41db6 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] [instance: 8f7f3be8-21d5-446e-9ee5-0caa7c97a68a] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:31.049338 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-04a35a64-cde8-4390-a2bf-713c0ab080fb tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:31.050101 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-04a35a64-cde8-4390-a2bf-713c0ab080fb tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:31.050538 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-04a35a64-cde8-4390-a2bf-713c0ab080fb tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:31.055256 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a85b0233-7ef2-45dc-8766-12fba2b41db6 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:31.055741 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a85b0233-7ef2-45dc-8766-12fba2b41db6 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:31.056560 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a85b0233-7ef2-45dc-8766-12fba2b41db6 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:31.056992 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a85b0233-7ef2-45dc-8766-12fba2b41db6 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:31.118216 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-a85b0233-7ef2-45dc-8766-12fba2b41db6 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4fc7744b3d4e5fb6e281fcc90cef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b84dd581fc4e9499cfecbb7242e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:31.125898 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-a85b0233-7ef2-45dc-8766-12fba2b41db6 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] 10.222.0.13 "GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a" status: 200 len: 1270 microversion: 2.1 time: 0.081053 Jun 07 22:04:31.126486 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 107/235] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:31 2022] GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a => generated 1270 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:04:31.186174 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-04a35a64-cde8-4390-a2bf-713c0ab080fb tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:31.197402 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-04a35a64-cde8-4390-a2bf-713c0ab080fb tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836" status: 200 len: 1368 microversion: 2.1 time: 0.160223 Jun 07 22:04:31.201649 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-beba07da-a5bd-48d1-bc55-8346a845ba02 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:31.201908 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 129/236] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:31 2022] GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836 => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:31.202252 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-beba07da-a5bd-48d1-bc55-8346a845ba02 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:31.210913 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-beba07da-a5bd-48d1-bc55-8346a845ba02 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:31.211638 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-beba07da-a5bd-48d1-bc55-8346a845ba02 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:31.214021 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-beba07da-a5bd-48d1-bc55-8346a845ba02 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:31.214777 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-beba07da-a5bd-48d1-bc55-8346a845ba02 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:31.355713 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-beba07da-a5bd-48d1-bc55-8346a845ba02 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:31.365412 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-3bcf4518-ac1b-4629-ad39-73187653dd88 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:31.366067 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-beba07da-a5bd-48d1-bc55-8346a845ba02 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1321 microversion: 2.1 time: 0.168385 Jun 07 22:04:31.366644 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 108/237] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:31 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1321 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:31.372450 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-3bcf4518-ac1b-4629-ad39-73187653dd88 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:31.387558 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-3bcf4518-ac1b-4629-ad39-73187653dd88 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:31.388494 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-3bcf4518-ac1b-4629-ad39-73187653dd88 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:31.389804 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-3bcf4518-ac1b-4629-ad39-73187653dd88 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:31.390401 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-3bcf4518-ac1b-4629-ad39-73187653dd88 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:31.531054 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-3bcf4518-ac1b-4629-ad39-73187653dd88 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:31.541301 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-3bcf4518-ac1b-4629-ad39-73187653dd88 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1360 microversion: 2.1 time: 0.179164 Jun 07 22:04:31.542107 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 130/238] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:31 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1360 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:04:32.142958 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-b0b12629-1e39-42c2-a0e4-25abbfd8971f tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:32.143514 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-b0b12629-1e39-42c2-a0e4-25abbfd8971f tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] [instance: 8f7f3be8-21d5-446e-9ee5-0caa7c97a68a] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:32.149448 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-b0b12629-1e39-42c2-a0e4-25abbfd8971f tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:32.149887 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-b0b12629-1e39-42c2-a0e4-25abbfd8971f tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:32.150626 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-b0b12629-1e39-42c2-a0e4-25abbfd8971f tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:32.151047 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-b0b12629-1e39-42c2-a0e4-25abbfd8971f tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:32.214378 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-84fa695d-a9a0-47bb-addb-fa4779b61b71 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:32.215052 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-84fa695d-a9a0-47bb-addb-fa4779b61b71 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 5704eeef-7ef8-4e6d-b39d-d672e9592836] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:32.217343 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-b0b12629-1e39-42c2-a0e4-25abbfd8971f tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4fc7744b3d4e5fb6e281fcc90cef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b84dd581fc4e9499cfecbb7242e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:32.222006 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-84fa695d-a9a0-47bb-addb-fa4779b61b71 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:32.222449 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-84fa695d-a9a0-47bb-addb-fa4779b61b71 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:32.223246 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-84fa695d-a9a0-47bb-addb-fa4779b61b71 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:32.223713 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-84fa695d-a9a0-47bb-addb-fa4779b61b71 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:32.224906 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-b0b12629-1e39-42c2-a0e4-25abbfd8971f tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] 10.222.0.13 "GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a" status: 200 len: 1270 microversion: 2.1 time: 0.085747 Jun 07 22:04:32.225488 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 109/239] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:32 2022] GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a => generated 1270 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:32.363455 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-84fa695d-a9a0-47bb-addb-fa4779b61b71 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:32.372172 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-84fa695d-a9a0-47bb-addb-fa4779b61b71 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836" status: 200 len: 1368 microversion: 2.1 time: 0.161975 Jun 07 22:04:32.372741 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 131/240] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:32 2022] GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836 => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:04:32.384192 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-a4755f7d-4ca0-4949-9d3d-ffec14d5fca9 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:32.384799 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-a4755f7d-4ca0-4949-9d3d-ffec14d5fca9 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:32.390770 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a4755f7d-4ca0-4949-9d3d-ffec14d5fca9 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:32.391222 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a4755f7d-4ca0-4949-9d3d-ffec14d5fca9 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:32.392018 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a4755f7d-4ca0-4949-9d3d-ffec14d5fca9 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:32.392451 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a4755f7d-4ca0-4949-9d3d-ffec14d5fca9 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:32.523563 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-a4755f7d-4ca0-4949-9d3d-ffec14d5fca9 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:32.532324 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-a4755f7d-4ca0-4949-9d3d-ffec14d5fca9 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1515 microversion: 2.1 time: 0.152988 Jun 07 22:04:32.532895 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 110/241] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:32 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:32.551033 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-c2537d90-87bf-4531-ae09-7f311fa5d35f tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:04:32.552104 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-c2537d90-87bf-4531-ae09-7f311fa5d35f tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:32.559007 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-63622955-a0bb-4ec0-80ca-0108b837d413 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:32.559223 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c2537d90-87bf-4531-ae09-7f311fa5d35f tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:32.559595 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c2537d90-87bf-4531-ae09-7f311fa5d35f tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:32.559712 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-63622955-a0bb-4ec0-80ca-0108b837d413 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:32.560463 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c2537d90-87bf-4531-ae09-7f311fa5d35f tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:32.561113 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c2537d90-87bf-4531-ae09-7f311fa5d35f tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:32.567359 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-63622955-a0bb-4ec0-80ca-0108b837d413 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:32.567359 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-63622955-a0bb-4ec0-80ca-0108b837d413 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:32.568220 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-63622955-a0bb-4ec0-80ca-0108b837d413 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:32.568683 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-63622955-a0bb-4ec0-80ca-0108b837d413 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:32.595447 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.objects.instance [None req-c2537d90-87bf-4531-ae09-7f311fa5d35f tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lazy-loading 'flavor' on Instance uuid 73af9eba-632b-4035-a6ad-02f4fa11866a {{(pid=117971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 22:04:32.710126 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-63622955-a0bb-4ec0-80ca-0108b837d413 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:32.718355 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-63622955-a0bb-4ec0-80ca-0108b837d413 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1360 microversion: 2.1 time: 0.164027 Jun 07 22:04:32.718922 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 111/242] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:32 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1360 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:04:32.729838 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-c2537d90-87bf-4531-ae09-7f311fa5d35f tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "POST /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a/action" status: 200 len: 32 microversion: 2.1 time: 0.183311 Jun 07 22:04:32.730439 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 132/243] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Jun 7 22:04:32 2022] POST /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a/action => generated 32 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 07 22:04:32.738966 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-b6a9ada8-92f8-400e-a7be-3ca442f5575d tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:32.739606 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-b6a9ada8-92f8-400e-a7be-3ca442f5575d tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:32.745568 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-b6a9ada8-92f8-400e-a7be-3ca442f5575d tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:32.746006 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-b6a9ada8-92f8-400e-a7be-3ca442f5575d tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:32.746759 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-b6a9ada8-92f8-400e-a7be-3ca442f5575d tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:32.747206 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-b6a9ada8-92f8-400e-a7be-3ca442f5575d tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:32.877205 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-b6a9ada8-92f8-400e-a7be-3ca442f5575d tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:32.885404 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-b6a9ada8-92f8-400e-a7be-3ca442f5575d tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1521 microversion: 2.1 time: 0.149836 Jun 07 22:04:32.885970 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 112/244] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:32 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:33.246469 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-539a5483-401e-45ea-8fa8-3be2f92cfb84 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:33.247180 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-539a5483-401e-45ea-8fa8-3be2f92cfb84 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] [instance: 8f7f3be8-21d5-446e-9ee5-0caa7c97a68a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:33.254622 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-539a5483-401e-45ea-8fa8-3be2f92cfb84 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:33.255156 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-539a5483-401e-45ea-8fa8-3be2f92cfb84 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:33.255896 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-539a5483-401e-45ea-8fa8-3be2f92cfb84 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:33.256347 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-539a5483-401e-45ea-8fa8-3be2f92cfb84 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:33.328603 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-539a5483-401e-45ea-8fa8-3be2f92cfb84 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4fc7744b3d4e5fb6e281fcc90cef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b84dd581fc4e9499cfecbb7242e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:33.336425 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-539a5483-401e-45ea-8fa8-3be2f92cfb84 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] 10.222.0.13 "GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a" status: 200 len: 1270 microversion: 2.1 time: 0.094979 Jun 07 22:04:33.337040 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 133/245] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:33 2022] GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a => generated 1270 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:33.389292 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-c04e9170-d512-4f79-86f7-ab47934765bc tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:33.390536 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-c04e9170-d512-4f79-86f7-ab47934765bc tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 5704eeef-7ef8-4e6d-b39d-d672e9592836] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:33.396606 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c04e9170-d512-4f79-86f7-ab47934765bc tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:33.397051 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c04e9170-d512-4f79-86f7-ab47934765bc tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:33.397806 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c04e9170-d512-4f79-86f7-ab47934765bc tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:33.398406 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c04e9170-d512-4f79-86f7-ab47934765bc tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:33.678266 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-c04e9170-d512-4f79-86f7-ab47934765bc tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:33.687310 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-c04e9170-d512-4f79-86f7-ab47934765bc tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836" status: 200 len: 1368 microversion: 2.1 time: 0.301836 Jun 07 22:04:33.688079 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 113/246] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:33 2022] GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836 => generated 1368 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:33.736340 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-ee7458ad-cb01-4733-a41f-ecfc928b0192 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:33.736950 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-ee7458ad-cb01-4733-a41f-ecfc928b0192 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:33.743630 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ee7458ad-cb01-4733-a41f-ecfc928b0192 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:33.744080 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ee7458ad-cb01-4733-a41f-ecfc928b0192 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:33.744843 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ee7458ad-cb01-4733-a41f-ecfc928b0192 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:33.745271 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ee7458ad-cb01-4733-a41f-ecfc928b0192 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:33.881700 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-ee7458ad-cb01-4733-a41f-ecfc928b0192 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:33.889977 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-ee7458ad-cb01-4733-a41f-ecfc928b0192 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1360 microversion: 2.1 time: 0.157427 Jun 07 22:04:33.890560 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 134/247] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:33 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1360 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:33.903666 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-a837310f-70c2-4a64-ae16-a5aba8b80c23 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:33.904362 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-a837310f-70c2-4a64-ae16-a5aba8b80c23 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:33.912970 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a837310f-70c2-4a64-ae16-a5aba8b80c23 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:33.913802 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a837310f-70c2-4a64-ae16-a5aba8b80c23 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:33.914659 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a837310f-70c2-4a64-ae16-a5aba8b80c23 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:33.915169 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a837310f-70c2-4a64-ae16-a5aba8b80c23 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:34.053605 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-a837310f-70c2-4a64-ae16-a5aba8b80c23 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:34.061972 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-a837310f-70c2-4a64-ae16-a5aba8b80c23 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1521 microversion: 2.1 time: 0.163426 Jun 07 22:04:34.062726 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 114/248] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:33 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:34.353221 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-b1d691af-22b4-4f7c-97fd-f1aa00ef085f tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:34.353826 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-b1d691af-22b4-4f7c-97fd-f1aa00ef085f tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] [instance: 8f7f3be8-21d5-446e-9ee5-0caa7c97a68a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:34.360247 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b1d691af-22b4-4f7c-97fd-f1aa00ef085f tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:34.360695 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b1d691af-22b4-4f7c-97fd-f1aa00ef085f tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:34.361441 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b1d691af-22b4-4f7c-97fd-f1aa00ef085f tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:34.361871 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b1d691af-22b4-4f7c-97fd-f1aa00ef085f tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:34.421361 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-b1d691af-22b4-4f7c-97fd-f1aa00ef085f tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4fc7744b3d4e5fb6e281fcc90cef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b84dd581fc4e9499cfecbb7242e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:34.428917 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-b1d691af-22b4-4f7c-97fd-f1aa00ef085f tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] 10.222.0.13 "GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a" status: 200 len: 1278 microversion: 2.1 time: 0.079769 Jun 07 22:04:34.429641 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 135/249] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:34 2022] GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a => generated 1278 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:34.704836 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-fdf746fc-ea02-40e7-8779-65fff40a0d4a tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:34.705573 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-fdf746fc-ea02-40e7-8779-65fff40a0d4a tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 5704eeef-7ef8-4e6d-b39d-d672e9592836] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:34.713059 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-fdf746fc-ea02-40e7-8779-65fff40a0d4a tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:34.713583 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-fdf746fc-ea02-40e7-8779-65fff40a0d4a tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:34.714848 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-fdf746fc-ea02-40e7-8779-65fff40a0d4a tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:34.715480 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-fdf746fc-ea02-40e7-8779-65fff40a0d4a tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:34.853346 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-fdf746fc-ea02-40e7-8779-65fff40a0d4a tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:34.860759 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-fdf746fc-ea02-40e7-8779-65fff40a0d4a tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836" status: 200 len: 1368 microversion: 2.1 time: 0.160149 Jun 07 22:04:34.861326 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 115/250] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:34 2022] GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836 => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:34.906402 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-c0e545a6-5070-4a5f-a548-d869bf0d803b tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:34.907003 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-c0e545a6-5070-4a5f-a548-d869bf0d803b tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:34.913566 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c0e545a6-5070-4a5f-a548-d869bf0d803b tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:34.914016 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c0e545a6-5070-4a5f-a548-d869bf0d803b tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:34.914770 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c0e545a6-5070-4a5f-a548-d869bf0d803b tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:34.915205 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c0e545a6-5070-4a5f-a548-d869bf0d803b tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:34.933952 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:04:35.078786 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-65d2520e-d9f8-4b04-b290-a259abffdc47 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:35.079797 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-65d2520e-d9f8-4b04-b290-a259abffdc47 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:35.086338 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-65d2520e-d9f8-4b04-b290-a259abffdc47 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:35.086866 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-65d2520e-d9f8-4b04-b290-a259abffdc47 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:35.087920 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-65d2520e-d9f8-4b04-b290-a259abffdc47 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:35.088430 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-65d2520e-d9f8-4b04-b290-a259abffdc47 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:35.101827 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-c0e545a6-5070-4a5f-a548-d869bf0d803b tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:35.121533 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-c0e545a6-5070-4a5f-a548-d869bf0d803b tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1360 microversion: 2.1 time: 0.218768 Jun 07 22:04:35.131412 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 136/251] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:34 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1360 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:35.235167 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-65d2520e-d9f8-4b04-b290-a259abffdc47 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:35.243017 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-65d2520e-d9f8-4b04-b290-a259abffdc47 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1521 microversion: 2.1 time: 0.168337 Jun 07 22:04:35.244432 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 116/252] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:35 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:04:35.448535 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-aa00978f-2f00-4526-b020-b43e539411fc tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:35.452172 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-aa00978f-2f00-4526-b020-b43e539411fc tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] [instance: 8f7f3be8-21d5-446e-9ee5-0caa7c97a68a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:35.467764 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-aa00978f-2f00-4526-b020-b43e539411fc tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:35.469182 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-aa00978f-2f00-4526-b020-b43e539411fc tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:35.470138 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-aa00978f-2f00-4526-b020-b43e539411fc tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:35.472557 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-aa00978f-2f00-4526-b020-b43e539411fc tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:35.599561 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-aa00978f-2f00-4526-b020-b43e539411fc tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4fc7744b3d4e5fb6e281fcc90cef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b84dd581fc4e9499cfecbb7242e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:35.608328 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-aa00978f-2f00-4526-b020-b43e539411fc tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] 10.222.0.13 "GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a" status: 200 len: 1278 microversion: 2.1 time: 0.164740 Jun 07 22:04:35.608900 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 137/253] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:35 2022] GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a => generated 1278 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:35.878017 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-556a7497-3449-44c0-83d8-b5de2eb8ceb1 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:35.881581 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-556a7497-3449-44c0-83d8-b5de2eb8ceb1 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 5704eeef-7ef8-4e6d-b39d-d672e9592836] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:35.885119 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-556a7497-3449-44c0-83d8-b5de2eb8ceb1 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:35.885569 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-556a7497-3449-44c0-83d8-b5de2eb8ceb1 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:35.886333 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-556a7497-3449-44c0-83d8-b5de2eb8ceb1 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:35.886938 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-556a7497-3449-44c0-83d8-b5de2eb8ceb1 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:36.028351 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-556a7497-3449-44c0-83d8-b5de2eb8ceb1 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:36.030707 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_cell1:SELECT=100 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:04:36.037164 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-556a7497-3449-44c0-83d8-b5de2eb8ceb1 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836" status: 200 len: 1558 microversion: 2.1 time: 0.163204 Jun 07 22:04:36.037731 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 117/254] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:35 2022] GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836 => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:36.054578 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-ecd7c8b6-11cd-430b-8a96-19d03d06e593 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:36.055066 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-ecd7c8b6-11cd-430b-8a96-19d03d06e593 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 5704eeef-7ef8-4e6d-b39d-d672e9592836] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:36.062355 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ecd7c8b6-11cd-430b-8a96-19d03d06e593 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:36.062800 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ecd7c8b6-11cd-430b-8a96-19d03d06e593 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:36.063592 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ecd7c8b6-11cd-430b-8a96-19d03d06e593 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:36.064081 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ecd7c8b6-11cd-430b-8a96-19d03d06e593 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:36.138995 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-6fbca5f0-b8fa-4bef-8c7c-889a05c86e0f tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:36.139780 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-6fbca5f0-b8fa-4bef-8c7c-889a05c86e0f tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:36.146008 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6fbca5f0-b8fa-4bef-8c7c-889a05c86e0f tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:36.146607 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6fbca5f0-b8fa-4bef-8c7c-889a05c86e0f tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:36.147401 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6fbca5f0-b8fa-4bef-8c7c-889a05c86e0f tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:36.147833 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6fbca5f0-b8fa-4bef-8c7c-889a05c86e0f tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:36.335857 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-ecd7c8b6-11cd-430b-8a96-19d03d06e593 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.284848 Jun 07 22:04:36.336629 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 138/255] 10.222.0.13 () {58 vars in 1274 bytes} [Tue Jun 7 22:04:36 2022] GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836/os-interface => generated 284 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 22:04:36.339272 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-6fbca5f0-b8fa-4bef-8c7c-889a05c86e0f tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:36.342545 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-bc01341d-4710-40eb-94c5-9d35174f2e3f tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:36.343260 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-bc01341d-4710-40eb-94c5-9d35174f2e3f tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:36.351439 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-bc01341d-4710-40eb-94c5-9d35174f2e3f tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:36.351969 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-6fbca5f0-b8fa-4bef-8c7c-889a05c86e0f tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1360 microversion: 2.1 time: 0.217494 Jun 07 22:04:36.352630 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-bc01341d-4710-40eb-94c5-9d35174f2e3f tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:36.354273 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-bc01341d-4710-40eb-94c5-9d35174f2e3f tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:36.354858 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-bc01341d-4710-40eb-94c5-9d35174f2e3f tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:36.360784 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 118/256] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:36 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1360 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:04:36.561790 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-bc01341d-4710-40eb-94c5-9d35174f2e3f tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:36.569954 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-bc01341d-4710-40eb-94c5-9d35174f2e3f tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1521 microversion: 2.1 time: 0.231591 Jun 07 22:04:36.570778 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 139/257] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:36 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:36.628850 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-d0d055b5-a829-48a9-8d6d-72fd5359668e tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:36.629750 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-d0d055b5-a829-48a9-8d6d-72fd5359668e tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] [instance: 8f7f3be8-21d5-446e-9ee5-0caa7c97a68a] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:36.636770 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d0d055b5-a829-48a9-8d6d-72fd5359668e tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:36.637412 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d0d055b5-a829-48a9-8d6d-72fd5359668e tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:36.638290 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d0d055b5-a829-48a9-8d6d-72fd5359668e tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:36.638717 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d0d055b5-a829-48a9-8d6d-72fd5359668e tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:36.720990 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-d0d055b5-a829-48a9-8d6d-72fd5359668e tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4fc7744b3d4e5fb6e281fcc90cef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b84dd581fc4e9499cfecbb7242e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:36.729525 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-d0d055b5-a829-48a9-8d6d-72fd5359668e tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] 10.222.0.13 "GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a" status: 200 len: 1288 microversion: 2.1 time: 0.107189 Jun 07 22:04:36.740127 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 119/258] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:36 2022] GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a => generated 1288 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:37.370763 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-091d4c8b-8544-4ffe-9b79-015e9ac69a45 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:37.371388 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-091d4c8b-8544-4ffe-9b79-015e9ac69a45 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:37.380064 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-091d4c8b-8544-4ffe-9b79-015e9ac69a45 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:37.380637 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-091d4c8b-8544-4ffe-9b79-015e9ac69a45 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:37.381406 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-091d4c8b-8544-4ffe-9b79-015e9ac69a45 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:37.381839 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-091d4c8b-8544-4ffe-9b79-015e9ac69a45 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:37.586345 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-9c32bc59-a4ae-4752-bf4c-44d30d169190 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:37.586959 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-9c32bc59-a4ae-4752-bf4c-44d30d169190 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:37.594174 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-9c32bc59-a4ae-4752-bf4c-44d30d169190 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:37.594863 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-9c32bc59-a4ae-4752-bf4c-44d30d169190 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:37.595810 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-9c32bc59-a4ae-4752-bf4c-44d30d169190 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:37.597017 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-9c32bc59-a4ae-4752-bf4c-44d30d169190 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:37.680360 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-091d4c8b-8544-4ffe-9b79-015e9ac69a45 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:37.694713 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-091d4c8b-8544-4ffe-9b79-015e9ac69a45 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1360 microversion: 2.1 time: 0.328322 Jun 07 22:04:37.704792 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 140/259] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:37 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1360 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:37.748565 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-1495d023-74f2-44f2-b8bc-8c6255fdc950 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:37.749176 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-1495d023-74f2-44f2-b8bc-8c6255fdc950 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] [instance: 8f7f3be8-21d5-446e-9ee5-0caa7c97a68a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:37.756021 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-1495d023-74f2-44f2-b8bc-8c6255fdc950 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:37.756832 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-1495d023-74f2-44f2-b8bc-8c6255fdc950 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:37.757803 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-1495d023-74f2-44f2-b8bc-8c6255fdc950 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:37.758420 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-1495d023-74f2-44f2-b8bc-8c6255fdc950 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:37.818994 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-9c32bc59-a4ae-4752-bf4c-44d30d169190 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:37.832065 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-9c32bc59-a4ae-4752-bf4c-44d30d169190 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1521 microversion: 2.1 time: 0.249443 Jun 07 22:04:37.833509 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 120/260] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:37 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1521 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:04:37.877179 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-1495d023-74f2-44f2-b8bc-8c6255fdc950 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4fc7744b3d4e5fb6e281fcc90cef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b84dd581fc4e9499cfecbb7242e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:37.889530 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-1495d023-74f2-44f2-b8bc-8c6255fdc950 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] 10.222.0.13 "GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a" status: 200 len: 1276 microversion: 2.1 time: 0.145083 Jun 07 22:04:37.890458 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 141/261] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:37 2022] GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a => generated 1276 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:38.062108 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [req-88aa608a-4dd0-4014-866e-d620fd1c4fe2 req-4c87a75d-3e95-4363-be39-cdc25791de92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5704eeef-7ef8-4e6d-b39d-d672e9592836", "tag": "f75804a7-9ce5-44ca-82e4-e1f8a373373a"}]} {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:04:38.070572 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [req-88aa608a-4dd0-4014-866e-d620fd1c4fe2 req-4c87a75d-3e95-4363-be39-cdc25791de92 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:38.071952 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [req-88aa608a-4dd0-4014-866e-d620fd1c4fe2 req-4c87a75d-3e95-4363-be39-cdc25791de92 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:38.084993 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.compute.server_external_events [req-88aa608a-4dd0-4014-866e-d620fd1c4fe2 req-4c87a75d-3e95-4363-be39-cdc25791de92 service nova] Creating event network-changed:f75804a7-9ce5-44ca-82e4-e1f8a373373a for instance 5704eeef-7ef8-4e6d-b39d-d672e9592836 on hv-cinder-83552 Jun 07 22:04:38.092351 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [req-88aa608a-4dd0-4014-866e-d620fd1c4fe2 req-4c87a75d-3e95-4363-be39-cdc25791de92 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033973 Jun 07 22:04:38.092958 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 121/262] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:04:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:04:38.712853 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-64898850-4d34-4119-85a3-daf3e639173b tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:38.713453 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-64898850-4d34-4119-85a3-daf3e639173b tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:38.720142 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-64898850-4d34-4119-85a3-daf3e639173b tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:38.720593 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-64898850-4d34-4119-85a3-daf3e639173b tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:38.721339 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-64898850-4d34-4119-85a3-daf3e639173b tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:38.721765 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-64898850-4d34-4119-85a3-daf3e639173b tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:38.851525 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-cfb725e1-4ae2-432e-b125-235d497081fd tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:38.852220 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-cfb725e1-4ae2-432e-b125-235d497081fd tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:38.859098 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-cfb725e1-4ae2-432e-b125-235d497081fd tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:38.859782 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-cfb725e1-4ae2-432e-b125-235d497081fd tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:38.860642 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-cfb725e1-4ae2-432e-b125-235d497081fd tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:38.861212 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-cfb725e1-4ae2-432e-b125-235d497081fd tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:38.874509 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-64898850-4d34-4119-85a3-daf3e639173b tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:38.882973 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-64898850-4d34-4119-85a3-daf3e639173b tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1360 microversion: 2.1 time: 0.174382 Jun 07 22:04:38.883719 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 142/263] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:38 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1360 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:38.906483 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-801bb0a1-14aa-4dc3-bec6-baa2e4260bd6 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:38.907084 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-801bb0a1-14aa-4dc3-bec6-baa2e4260bd6 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] [instance: 8f7f3be8-21d5-446e-9ee5-0caa7c97a68a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:38.913083 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-801bb0a1-14aa-4dc3-bec6-baa2e4260bd6 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:38.913530 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-801bb0a1-14aa-4dc3-bec6-baa2e4260bd6 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:38.914291 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-801bb0a1-14aa-4dc3-bec6-baa2e4260bd6 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:38.914720 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-801bb0a1-14aa-4dc3-bec6-baa2e4260bd6 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:39.005569 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-cfb725e1-4ae2-432e-b125-235d497081fd tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:39.016042 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-cfb725e1-4ae2-432e-b125-235d497081fd tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1521 microversion: 2.1 time: 0.169117 Jun 07 22:04:39.016762 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 122/264] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:38 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:04:39.049531 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-801bb0a1-14aa-4dc3-bec6-baa2e4260bd6 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4fc7744b3d4e5fb6e281fcc90cef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b84dd581fc4e9499cfecbb7242e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:39.057338 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-801bb0a1-14aa-4dc3-bec6-baa2e4260bd6 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] 10.222.0.13 "GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a" status: 200 len: 1318 microversion: 2.1 time: 0.154655 Jun 07 22:04:39.057916 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 143/265] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:38 2022] GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:04:39.900496 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-434db410-a62d-4398-ad37-f17dc4006ad1 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:39.901247 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-434db410-a62d-4398-ad37-f17dc4006ad1 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:39.907413 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-434db410-a62d-4398-ad37-f17dc4006ad1 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:39.907917 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-434db410-a62d-4398-ad37-f17dc4006ad1 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:39.909294 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-434db410-a62d-4398-ad37-f17dc4006ad1 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:39.909839 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-434db410-a62d-4398-ad37-f17dc4006ad1 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:40.033375 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-12d081cc-9e5d-4505-93d5-7e08fa8c76f3 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:40.034001 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-12d081cc-9e5d-4505-93d5-7e08fa8c76f3 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:40.040686 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-12d081cc-9e5d-4505-93d5-7e08fa8c76f3 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:40.041128 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-12d081cc-9e5d-4505-93d5-7e08fa8c76f3 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:40.041880 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-12d081cc-9e5d-4505-93d5-7e08fa8c76f3 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:40.042305 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-12d081cc-9e5d-4505-93d5-7e08fa8c76f3 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:40.047250 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-434db410-a62d-4398-ad37-f17dc4006ad1 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:40.054623 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-434db410-a62d-4398-ad37-f17dc4006ad1 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1360 microversion: 2.1 time: 0.158863 Jun 07 22:04:40.055195 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 123/266] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:39 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1360 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:40.074213 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-11cb6210-2a06-470b-b3d1-3e3b6a1820a9 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:40.074819 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-11cb6210-2a06-470b-b3d1-3e3b6a1820a9 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] [instance: 8f7f3be8-21d5-446e-9ee5-0caa7c97a68a] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:40.080913 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-11cb6210-2a06-470b-b3d1-3e3b6a1820a9 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:40.081363 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-11cb6210-2a06-470b-b3d1-3e3b6a1820a9 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:40.082132 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-11cb6210-2a06-470b-b3d1-3e3b6a1820a9 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:40.082569 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-11cb6210-2a06-470b-b3d1-3e3b6a1820a9 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:40.175039 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-12d081cc-9e5d-4505-93d5-7e08fa8c76f3 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:40.183314 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-12d081cc-9e5d-4505-93d5-7e08fa8c76f3 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1521 microversion: 2.1 time: 0.153751 Jun 07 22:04:40.187012 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 144/267] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:40 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:04:40.216797 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-11cb6210-2a06-470b-b3d1-3e3b6a1820a9 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4fc7744b3d4e5fb6e281fcc90cef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b84dd581fc4e9499cfecbb7242e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:40.224098 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-11cb6210-2a06-470b-b3d1-3e3b6a1820a9 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] 10.222.0.13 "GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a" status: 200 len: 1318 microversion: 2.1 time: 0.154183 Jun 07 22:04:40.224651 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 124/268] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:40 2022] GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:04:41.072704 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-6bad96c8-0be7-43af-bb49-db9fe55f26e0 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:41.073318 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-6bad96c8-0be7-43af-bb49-db9fe55f26e0 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:41.079848 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-6bad96c8-0be7-43af-bb49-db9fe55f26e0 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:41.080294 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-6bad96c8-0be7-43af-bb49-db9fe55f26e0 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:41.081043 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-6bad96c8-0be7-43af-bb49-db9fe55f26e0 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:41.081473 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-6bad96c8-0be7-43af-bb49-db9fe55f26e0 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:41.200198 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-45e88860-2158-4dd6-a550-3530ffcef86d tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:41.201459 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-45e88860-2158-4dd6-a550-3530ffcef86d tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:41.209658 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-45e88860-2158-4dd6-a550-3530ffcef86d tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:41.213565 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-45e88860-2158-4dd6-a550-3530ffcef86d tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:41.213565 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-45e88860-2158-4dd6-a550-3530ffcef86d tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:41.213565 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-45e88860-2158-4dd6-a550-3530ffcef86d tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:41.215109 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-6bad96c8-0be7-43af-bb49-db9fe55f26e0 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:41.222638 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-6bad96c8-0be7-43af-bb49-db9fe55f26e0 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1360 microversion: 2.1 time: 0.154435 Jun 07 22:04:41.223314 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 145/269] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:41 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1360 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:41.241015 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-f04f8002-3401-4b9a-af01-92b48d227ed5 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:41.241613 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-f04f8002-3401-4b9a-af01-92b48d227ed5 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] [instance: 8f7f3be8-21d5-446e-9ee5-0caa7c97a68a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:41.247617 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-f04f8002-3401-4b9a-af01-92b48d227ed5 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:41.248056 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-f04f8002-3401-4b9a-af01-92b48d227ed5 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:41.248810 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-f04f8002-3401-4b9a-af01-92b48d227ed5 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:41.249233 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-f04f8002-3401-4b9a-af01-92b48d227ed5 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:41.345432 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-45e88860-2158-4dd6-a550-3530ffcef86d tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:41.353215 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-45e88860-2158-4dd6-a550-3530ffcef86d tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1521 microversion: 2.1 time: 0.157660 Jun 07 22:04:41.353777 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 125/270] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:41 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:04:41.378080 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-f04f8002-3401-4b9a-af01-92b48d227ed5 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4fc7744b3d4e5fb6e281fcc90cef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b84dd581fc4e9499cfecbb7242e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:41.386021 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-f04f8002-3401-4b9a-af01-92b48d227ed5 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] 10.222.0.13 "GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a" status: 200 len: 1318 microversion: 2.1 time: 0.148857 Jun 07 22:04:41.386577 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 146/271] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:41 2022] GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:04:42.240668 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-2d0738aa-3996-4580-81ee-433118ae0994 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:42.241264 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-2d0738aa-3996-4580-81ee-433118ae0994 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:42.247466 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-2d0738aa-3996-4580-81ee-433118ae0994 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:42.247907 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-2d0738aa-3996-4580-81ee-433118ae0994 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:42.248647 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-2d0738aa-3996-4580-81ee-433118ae0994 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:42.249074 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-2d0738aa-3996-4580-81ee-433118ae0994 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:42.369875 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-b34d82c7-35da-4ecf-be75-bfb9d7d3c061 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:42.370599 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-b34d82c7-35da-4ecf-be75-bfb9d7d3c061 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:42.374903 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-2d0738aa-3996-4580-81ee-433118ae0994 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:42.377361 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b34d82c7-35da-4ecf-be75-bfb9d7d3c061 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:42.377887 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b34d82c7-35da-4ecf-be75-bfb9d7d3c061 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:42.378664 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b34d82c7-35da-4ecf-be75-bfb9d7d3c061 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:42.379094 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b34d82c7-35da-4ecf-be75-bfb9d7d3c061 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:42.382248 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-2d0738aa-3996-4580-81ee-433118ae0994 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1360 microversion: 2.1 time: 0.145459 Jun 07 22:04:42.383068 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 126/272] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:42 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1360 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:42.402287 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-483baec0-3be8-4042-abfc-b3ff95d2b5ae tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:42.402885 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-483baec0-3be8-4042-abfc-b3ff95d2b5ae tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] [instance: 8f7f3be8-21d5-446e-9ee5-0caa7c97a68a] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:42.408891 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-483baec0-3be8-4042-abfc-b3ff95d2b5ae tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:42.409332 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-483baec0-3be8-4042-abfc-b3ff95d2b5ae tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:42.410079 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-483baec0-3be8-4042-abfc-b3ff95d2b5ae tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:42.410505 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-483baec0-3be8-4042-abfc-b3ff95d2b5ae tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:42.522251 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-b34d82c7-35da-4ecf-be75-bfb9d7d3c061 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:42.532175 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-b34d82c7-35da-4ecf-be75-bfb9d7d3c061 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1521 microversion: 2.1 time: 0.166312 Jun 07 22:04:42.544521 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 147/273] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:42 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:04:42.663943 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-483baec0-3be8-4042-abfc-b3ff95d2b5ae tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4fc7744b3d4e5fb6e281fcc90cef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b84dd581fc4e9499cfecbb7242e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:42.672411 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-483baec0-3be8-4042-abfc-b3ff95d2b5ae tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] 10.222.0.13 "GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a" status: 200 len: 1318 microversion: 2.1 time: 0.274248 Jun 07 22:04:42.672990 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 127/274] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:42 2022] GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a => generated 1318 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:04:43.311798 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [req-636b303b-5026-400a-83b5-7a93cf877063 req-80e0a0a3-4e47-4428-9749-f3dcf417839c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f7f3be8-21d5-446e-9ee5-0caa7c97a68a", "tag": "68d9825d-4732-4ff9-baca-ebb1dff29654"}]} {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:04:43.320747 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-636b303b-5026-400a-83b5-7a93cf877063 req-80e0a0a3-4e47-4428-9749-f3dcf417839c service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:43.322162 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-636b303b-5026-400a-83b5-7a93cf877063 req-80e0a0a3-4e47-4428-9749-f3dcf417839c service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:43.336461 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.compute.server_external_events [req-636b303b-5026-400a-83b5-7a93cf877063 req-80e0a0a3-4e47-4428-9749-f3dcf417839c service nova] Creating event network-changed:68d9825d-4732-4ff9-baca-ebb1dff29654 for instance 8f7f3be8-21d5-446e-9ee5-0caa7c97a68a on hv-cinder-83552 Jun 07 22:04:43.342403 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [req-636b303b-5026-400a-83b5-7a93cf877063 req-80e0a0a3-4e47-4428-9749-f3dcf417839c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034367 Jun 07 22:04:43.342998 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 148/275] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:04:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 22:04:43.399133 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-e50486a6-5712-4486-b59e-4ad6c1e16537 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:43.400886 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-e50486a6-5712-4486-b59e-4ad6c1e16537 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:43.406416 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e50486a6-5712-4486-b59e-4ad6c1e16537 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:43.406853 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e50486a6-5712-4486-b59e-4ad6c1e16537 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:43.407632 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e50486a6-5712-4486-b59e-4ad6c1e16537 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:43.408061 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e50486a6-5712-4486-b59e-4ad6c1e16537 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:43.536818 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-e50486a6-5712-4486-b59e-4ad6c1e16537 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:43.563279 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-17182b0d-8032-46bc-9ea8-a203cd2a6a3f tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:43.563279 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-17182b0d-8032-46bc-9ea8-a203cd2a6a3f tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:43.564656 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-e50486a6-5712-4486-b59e-4ad6c1e16537 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1545 microversion: 2.1 time: 0.159761 Jun 07 22:04:43.564656 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 128/276] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:43 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1545 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:04:43.564829 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-17182b0d-8032-46bc-9ea8-a203cd2a6a3f tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:43.564829 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-17182b0d-8032-46bc-9ea8-a203cd2a6a3f tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:43.564829 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-17182b0d-8032-46bc-9ea8-a203cd2a6a3f tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:43.564829 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-17182b0d-8032-46bc-9ea8-a203cd2a6a3f tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:43.573069 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-b7493e7b-fe04-4ba5-a6cb-327124e6c0b0 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:43.573683 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-b7493e7b-fe04-4ba5-a6cb-327124e6c0b0 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:43.580453 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-b7493e7b-fe04-4ba5-a6cb-327124e6c0b0 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:43.581020 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-b7493e7b-fe04-4ba5-a6cb-327124e6c0b0 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:43.581890 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-b7493e7b-fe04-4ba5-a6cb-327124e6c0b0 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:43.582439 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-b7493e7b-fe04-4ba5-a6cb-327124e6c0b0 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:43.702259 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-17182b0d-8032-46bc-9ea8-a203cd2a6a3f tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:43.705888 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-b7493e7b-fe04-4ba5-a6cb-327124e6c0b0 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.137151 Jun 07 22:04:43.706559 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 129/277] 10.222.0.13 () {58 vars in 1274 bytes} [Tue Jun 7 22:04:43 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609/os-interface => generated 284 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 22:04:43.710783 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-17182b0d-8032-46bc-9ea8-a203cd2a6a3f tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1521 microversion: 2.1 time: 0.164562 Jun 07 22:04:43.711383 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 149/278] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:43 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:43.716999 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-66098d5a-246e-4bfb-87be-fc69ee47eb30 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:43.717812 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-66098d5a-246e-4bfb-87be-fc69ee47eb30 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] [instance: 8f7f3be8-21d5-446e-9ee5-0caa7c97a68a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:43.724290 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-66098d5a-246e-4bfb-87be-fc69ee47eb30 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:43.725065 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-66098d5a-246e-4bfb-87be-fc69ee47eb30 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:43.726273 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-66098d5a-246e-4bfb-87be-fc69ee47eb30 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:43.726400 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-a2194a6d-8fb9-4462-8cc5-33374757044c tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1205539303", "imageRef": "87e2e140-6de8-4531-9681-d0a3e069622d", "flavorRef": "452"}} {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:04:43.727258 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-66098d5a-246e-4bfb-87be-fc69ee47eb30 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:43.790478 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.network.neutron [None req-a2194a6d-8fb9-4462-8cc5-33374757044c tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] validate_networks() for None {{(pid=117970) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 22:04:44.186864 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-66098d5a-246e-4bfb-87be-fc69ee47eb30 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4fc7744b3d4e5fb6e281fcc90cef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b84dd581fc4e9499cfecbb7242e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:44.209888 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-66098d5a-246e-4bfb-87be-fc69ee47eb30 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] 10.222.0.13 "GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a" status: 200 len: 1318 microversion: 2.1 time: 0.496559 Jun 07 22:04:44.211778 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 150/279] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:43 2022] GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a => generated 1318 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:44.220540 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-29b00fe0-6bbf-4e5d-9cf7-cd76dd4e4073 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:44.222654 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-29b00fe0-6bbf-4e5d-9cf7-cd76dd4e4073 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] [instance: b6a3577d-4aaf-4947-95c1-873076371ae7] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:44.232864 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-29b00fe0-6bbf-4e5d-9cf7-cd76dd4e4073 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:44.233888 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-29b00fe0-6bbf-4e5d-9cf7-cd76dd4e4073 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:44.246596 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-29b00fe0-6bbf-4e5d-9cf7-cd76dd4e4073 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:44.247446 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-29b00fe0-6bbf-4e5d-9cf7-cd76dd4e4073 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:44.297762 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-29b00fe0-6bbf-4e5d-9cf7-cd76dd4e4073 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] [instance: b6a3577d-4aaf-4947-95c1-873076371ae7] Going to try to terminate instance {{(pid=117971) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 22:04:44.306483 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.virt.hardware [None req-a2194a6d-8fb9-4462-8cc5-33374757044c tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Flavor limits 0:0:0 {{(pid=117970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 22:04:44.307011 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.virt.hardware [None req-a2194a6d-8fb9-4462-8cc5-33374757044c tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Image limits 0:0:0 {{(pid=117970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 22:04:44.307687 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.virt.hardware [None req-a2194a6d-8fb9-4462-8cc5-33374757044c tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Flavor pref 0:0:0 {{(pid=117970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 22:04:44.308101 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.virt.hardware [None req-a2194a6d-8fb9-4462-8cc5-33374757044c tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Image pref 0:0:0 {{(pid=117970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 22:04:44.308507 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.virt.hardware [None req-a2194a6d-8fb9-4462-8cc5-33374757044c tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 22:04:44.317924 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a2194a6d-8fb9-4462-8cc5-33374757044c tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:44.318368 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a2194a6d-8fb9-4462-8cc5-33374757044c tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:44.319148 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a2194a6d-8fb9-4462-8cc5-33374757044c tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:44.319617 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a2194a6d-8fb9-4462-8cc5-33374757044c tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:44.336663 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.quota [None req-a2194a6d-8fb9-4462-8cc5-33374757044c tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Getting quotas for project f240f9b198124b58826697af9f8ab205. Resources: {'cores', 'ram', 'instances'} {{(pid=117970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 22:04:44.340854 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.quota [None req-a2194a6d-8fb9-4462-8cc5-33374757044c tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Getting quotas for user d03864707f284a14ad9726c4023f32b8 and project f240f9b198124b58826697af9f8ab205. Resources: {'cores', 'ram', 'instances'} {{(pid=117970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 22:04:44.375864 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-a2194a6d-8fb9-4462-8cc5-33374757044c tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Going to run 1 instances... {{(pid=117970) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 22:04:44.378413 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-a2194a6d-8fb9-4462-8cc5-33374757044c tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] [instance: 4d0577c2-268e-4615-a373-379b4979836d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='87e2e140-6de8-4531-9681-d0a3e069622d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 22:04:44.437243 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-29b00fe0-6bbf-4e5d-9cf7-cd76dd4e4073 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] 10.222.0.13 "DELETE /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7" status: 204 len: 0 microversion: 2.1 time: 0.221227 Jun 07 22:04:44.439928 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 151/280] 10.222.0.13 () {58 vars in 1238 bytes} [Tue Jun 7 22:04:44 2022] DELETE /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 22:04:44.470375 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-7575d354-8d15-4d25-bdd6-2933a79bfc3b tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:44.471399 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-7575d354-8d15-4d25-bdd6-2933a79bfc3b tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] [instance: b6a3577d-4aaf-4947-95c1-873076371ae7] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:44.472221 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-a2194a6d-8fb9-4462-8cc5-33374757044c tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.756820 Jun 07 22:04:44.480063 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 130/281] 10.222.0.13 () {60 vars in 1146 bytes} [Tue Jun 7 22:04:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 772 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 22:04:44.486375 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-7575d354-8d15-4d25-bdd6-2933a79bfc3b tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:44.490351 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-7575d354-8d15-4d25-bdd6-2933a79bfc3b tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:44.491217 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-7575d354-8d15-4d25-bdd6-2933a79bfc3b tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:44.491684 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-7575d354-8d15-4d25-bdd6-2933a79bfc3b tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:44.492800 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-35b77f98-df68-4393-9ffd-82e3fd0913bb tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:44.493482 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-35b77f98-df68-4393-9ffd-82e3fd0913bb tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] [instance: 4d0577c2-268e-4615-a373-379b4979836d] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:44.551707 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:04:44.606426 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-35b77f98-df68-4393-9ffd-82e3fd0913bb tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03864707f284a14ad9726c4023f32b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f240f9b198124b58826697af9f8ab205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:44.615094 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-35b77f98-df68-4393-9ffd-82e3fd0913bb tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] 10.222.0.13 "GET /compute/v2.1/servers/4d0577c2-268e-4615-a373-379b4979836d" status: 200 len: 1215 microversion: 2.1 time: 0.132493 Jun 07 22:04:44.624719 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 131/282] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:44 2022] GET /compute/v2.1/servers/4d0577c2-268e-4615-a373-379b4979836d => generated 1215 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:44.730031 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-1ae0e0cf-fa10-4ddd-bcb0-48e5c46d156a tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:44.730749 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-1ae0e0cf-fa10-4ddd-bcb0-48e5c46d156a tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:44.738146 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1ae0e0cf-fa10-4ddd-bcb0-48e5c46d156a tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:44.738596 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1ae0e0cf-fa10-4ddd-bcb0-48e5c46d156a tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:44.739435 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1ae0e0cf-fa10-4ddd-bcb0-48e5c46d156a tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:44.739874 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1ae0e0cf-fa10-4ddd-bcb0-48e5c46d156a tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:44.896699 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-1ae0e0cf-fa10-4ddd-bcb0-48e5c46d156a tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:44.910136 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-1ae0e0cf-fa10-4ddd-bcb0-48e5c46d156a tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1521 microversion: 2.1 time: 0.186373 Jun 07 22:04:44.910952 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 132/283] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:44 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:45.103710 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-7575d354-8d15-4d25-bdd6-2933a79bfc3b tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1378a898f9534635857e5958d32f00c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8d5b4fdf9a48a296359e167017123f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:45.111883 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-7575d354-8d15-4d25-bdd6-2933a79bfc3b tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] 10.222.0.13 "GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7" status: 200 len: 1554 microversion: 2.1 time: 0.651781 Jun 07 22:04:45.112587 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 152/284] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:44 2022] GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7 => generated 1554 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:04:45.229434 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-86acb041-2312-44a1-91a4-84c83de40196 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:45.230213 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-86acb041-2312-44a1-91a4-84c83de40196 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] [instance: 8f7f3be8-21d5-446e-9ee5-0caa7c97a68a] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:45.236730 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-86acb041-2312-44a1-91a4-84c83de40196 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:45.237178 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-86acb041-2312-44a1-91a4-84c83de40196 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:45.237936 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-86acb041-2312-44a1-91a4-84c83de40196 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:45.238365 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-86acb041-2312-44a1-91a4-84c83de40196 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:45.367814 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-86acb041-2312-44a1-91a4-84c83de40196 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4fc7744b3d4e5fb6e281fcc90cef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b84dd581fc4e9499cfecbb7242e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:45.375227 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-86acb041-2312-44a1-91a4-84c83de40196 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] 10.222.0.13 "GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a" status: 200 len: 1318 microversion: 2.1 time: 0.151190 Jun 07 22:04:45.375824 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 133/285] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:45 2022] GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:45.567121 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [req-d90938fe-8833-4442-aba7-c5d1458fb7ed req-9e3c48cd-d21d-4a44-8fff-76e965c0e4e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f29be694-507c-48eb-9fdd-d20bef8f6609", "tag": "b5e13943-f98b-44ed-aa48-c5263e7a75d2"}]} {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:04:45.576332 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-d90938fe-8833-4442-aba7-c5d1458fb7ed req-9e3c48cd-d21d-4a44-8fff-76e965c0e4e9 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:45.576724 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-d90938fe-8833-4442-aba7-c5d1458fb7ed req-9e3c48cd-d21d-4a44-8fff-76e965c0e4e9 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:45.588435 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.compute.server_external_events [req-d90938fe-8833-4442-aba7-c5d1458fb7ed req-9e3c48cd-d21d-4a44-8fff-76e965c0e4e9 service nova] Creating event network-changed:b5e13943-f98b-44ed-aa48-c5263e7a75d2 for instance f29be694-507c-48eb-9fdd-d20bef8f6609 on hv-cinder-83552 Jun 07 22:04:45.596594 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [req-d90938fe-8833-4442-aba7-c5d1458fb7ed req-9e3c48cd-d21d-4a44-8fff-76e965c0e4e9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032986 Jun 07 22:04:45.597344 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 153/286] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:04:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:04:45.632429 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-b947704a-8e99-4089-a848-aea654c19e5c tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:45.633040 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-b947704a-8e99-4089-a848-aea654c19e5c tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] [instance: 4d0577c2-268e-4615-a373-379b4979836d] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:45.640439 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-b947704a-8e99-4089-a848-aea654c19e5c tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:45.643610 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-b947704a-8e99-4089-a848-aea654c19e5c tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:45.644484 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-b947704a-8e99-4089-a848-aea654c19e5c tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:45.645097 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-b947704a-8e99-4089-a848-aea654c19e5c tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:45.715045 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-b947704a-8e99-4089-a848-aea654c19e5c tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03864707f284a14ad9726c4023f32b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f240f9b198124b58826697af9f8ab205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:45.724792 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-b947704a-8e99-4089-a848-aea654c19e5c tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] 10.222.0.13 "GET /compute/v2.1/servers/4d0577c2-268e-4615-a373-379b4979836d" status: 200 len: 1219 microversion: 2.1 time: 0.096237 Jun 07 22:04:45.725631 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 134/287] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:45 2022] GET /compute/v2.1/servers/4d0577c2-268e-4615-a373-379b4979836d => generated 1219 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:45.928153 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-5dfc312e-3384-4526-998b-443bbe3d4a05 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:45.928832 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-5dfc312e-3384-4526-998b-443bbe3d4a05 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:45.935351 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-5dfc312e-3384-4526-998b-443bbe3d4a05 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:45.935810 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-5dfc312e-3384-4526-998b-443bbe3d4a05 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:45.936554 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-5dfc312e-3384-4526-998b-443bbe3d4a05 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:45.936994 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-5dfc312e-3384-4526-998b-443bbe3d4a05 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:46.070001 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-5dfc312e-3384-4526-998b-443bbe3d4a05 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:46.078385 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-5dfc312e-3384-4526-998b-443bbe3d4a05 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1521 microversion: 2.1 time: 0.154372 Jun 07 22:04:46.079025 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 154/288] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:45 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:46.129993 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-a1b1adc8-1126-4052-9670-46829e460e38 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:46.130671 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-a1b1adc8-1126-4052-9670-46829e460e38 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] [instance: b6a3577d-4aaf-4947-95c1-873076371ae7] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:46.137759 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a1b1adc8-1126-4052-9670-46829e460e38 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:46.138275 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a1b1adc8-1126-4052-9670-46829e460e38 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:46.139111 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a1b1adc8-1126-4052-9670-46829e460e38 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:46.139645 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a1b1adc8-1126-4052-9670-46829e460e38 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:46.379669 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-a1b1adc8-1126-4052-9670-46829e460e38 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1378a898f9534635857e5958d32f00c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8d5b4fdf9a48a296359e167017123f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:46.388883 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-a1b1adc8-1126-4052-9670-46829e460e38 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] 10.222.0.13 "GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7" status: 200 len: 1554 microversion: 2.1 time: 0.262732 Jun 07 22:04:46.389705 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 135/289] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:46 2022] GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7 => generated 1554 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:46.396918 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-1a0345be-2c60-4fec-a795-bd069ec03f7e tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:46.397533 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-1a0345be-2c60-4fec-a795-bd069ec03f7e tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] [instance: 8f7f3be8-21d5-446e-9ee5-0caa7c97a68a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:46.404147 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-1a0345be-2c60-4fec-a795-bd069ec03f7e tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:46.404599 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-1a0345be-2c60-4fec-a795-bd069ec03f7e tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:46.405365 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-1a0345be-2c60-4fec-a795-bd069ec03f7e tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:46.405804 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-1a0345be-2c60-4fec-a795-bd069ec03f7e tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:46.646211 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-1a0345be-2c60-4fec-a795-bd069ec03f7e tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4fc7744b3d4e5fb6e281fcc90cef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b84dd581fc4e9499cfecbb7242e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:46.661109 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-1a0345be-2c60-4fec-a795-bd069ec03f7e tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] 10.222.0.13 "GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a" status: 200 len: 1318 microversion: 2.1 time: 0.272812 Jun 07 22:04:46.670941 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 155/290] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:46 2022] GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a => generated 1318 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:04:46.742045 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-ea56035a-f051-4785-8e73-0bd752120edf tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:46.742651 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-ea56035a-f051-4785-8e73-0bd752120edf tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] [instance: 4d0577c2-268e-4615-a373-379b4979836d] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:46.749258 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-ea56035a-f051-4785-8e73-0bd752120edf tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:46.749699 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-ea56035a-f051-4785-8e73-0bd752120edf tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:46.750455 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-ea56035a-f051-4785-8e73-0bd752120edf tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:46.750886 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-ea56035a-f051-4785-8e73-0bd752120edf tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:46.857288 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-ea56035a-f051-4785-8e73-0bd752120edf tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03864707f284a14ad9726c4023f32b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f240f9b198124b58826697af9f8ab205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:46.878623 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-ea56035a-f051-4785-8e73-0bd752120edf tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] 10.222.0.13 "GET /compute/v2.1/servers/4d0577c2-268e-4615-a373-379b4979836d" status: 200 len: 1211 microversion: 2.1 time: 0.139247 Jun 07 22:04:46.881316 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 136/291] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:46 2022] GET /compute/v2.1/servers/4d0577c2-268e-4615-a373-379b4979836d => generated 1211 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:47.095268 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-26336c68-0bf0-4138-ab46-4d244f316e8b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:47.095904 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-26336c68-0bf0-4138-ab46-4d244f316e8b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:47.102257 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-26336c68-0bf0-4138-ab46-4d244f316e8b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:47.102860 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-26336c68-0bf0-4138-ab46-4d244f316e8b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:47.103904 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-26336c68-0bf0-4138-ab46-4d244f316e8b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:47.104309 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-26336c68-0bf0-4138-ab46-4d244f316e8b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:47.252419 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-26336c68-0bf0-4138-ab46-4d244f316e8b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:47.261775 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-26336c68-0bf0-4138-ab46-4d244f316e8b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1521 microversion: 2.1 time: 0.170420 Jun 07 22:04:47.262339 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 156/292] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:47 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:47.406378 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-f41cb5d8-2ce3-41af-a94f-67a76b161074 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:47.407020 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-f41cb5d8-2ce3-41af-a94f-67a76b161074 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] [instance: b6a3577d-4aaf-4947-95c1-873076371ae7] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:47.413150 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f41cb5d8-2ce3-41af-a94f-67a76b161074 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:47.413532 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f41cb5d8-2ce3-41af-a94f-67a76b161074 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:47.414294 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f41cb5d8-2ce3-41af-a94f-67a76b161074 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:47.414728 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f41cb5d8-2ce3-41af-a94f-67a76b161074 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:47.419610 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_cell1:SELECT=100 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:04:47.678719 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-8bc3b0c3-dfd2-4528-acb1-6cbaa1d245f0 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:47.680269 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-8bc3b0c3-dfd2-4528-acb1-6cbaa1d245f0 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] [instance: 8f7f3be8-21d5-446e-9ee5-0caa7c97a68a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:47.690824 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-8bc3b0c3-dfd2-4528-acb1-6cbaa1d245f0 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:47.692887 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-8bc3b0c3-dfd2-4528-acb1-6cbaa1d245f0 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:47.693368 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-8bc3b0c3-dfd2-4528-acb1-6cbaa1d245f0 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:47.693899 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-8bc3b0c3-dfd2-4528-acb1-6cbaa1d245f0 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:47.745364 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-f41cb5d8-2ce3-41af-a94f-67a76b161074 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1378a898f9534635857e5958d32f00c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8d5b4fdf9a48a296359e167017123f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:47.753467 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-f41cb5d8-2ce3-41af-a94f-67a76b161074 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] 10.222.0.13 "GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7" status: 200 len: 1554 microversion: 2.1 time: 0.350848 Jun 07 22:04:47.769791 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 137/293] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:47 2022] GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7 => generated 1554 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:47.896507 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-1ad2173a-976e-4153-811a-f9f3c86647a2 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:47.897650 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-1ad2173a-976e-4153-811a-f9f3c86647a2 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] [instance: 4d0577c2-268e-4615-a373-379b4979836d] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:47.899791 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:04:47.907576 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1ad2173a-976e-4153-811a-f9f3c86647a2 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:47.908534 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1ad2173a-976e-4153-811a-f9f3c86647a2 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:47.909639 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1ad2173a-976e-4153-811a-f9f3c86647a2 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:47.910236 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1ad2173a-976e-4153-811a-f9f3c86647a2 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:47.991826 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-1ad2173a-976e-4153-811a-f9f3c86647a2 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03864707f284a14ad9726c4023f32b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f240f9b198124b58826697af9f8ab205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:48.010306 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-1ad2173a-976e-4153-811a-f9f3c86647a2 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] 10.222.0.13 "GET /compute/v2.1/servers/4d0577c2-268e-4615-a373-379b4979836d" status: 200 len: 1273 microversion: 2.1 time: 0.117132 Jun 07 22:04:48.015702 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 138/294] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:47 2022] GET /compute/v2.1/servers/4d0577c2-268e-4615-a373-379b4979836d => generated 1273 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:04:48.203758 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-8bc3b0c3-dfd2-4528-acb1-6cbaa1d245f0 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4fc7744b3d4e5fb6e281fcc90cef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b84dd581fc4e9499cfecbb7242e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:48.215072 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-8bc3b0c3-dfd2-4528-acb1-6cbaa1d245f0 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] 10.222.0.13 "GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a" status: 200 len: 1318 microversion: 2.1 time: 0.540754 Jun 07 22:04:48.216501 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 157/295] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:47 2022] GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a => generated 1318 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:04:48.283265 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-a2d6af44-6855-4f72-9e7b-62dcf9d89dc4 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:48.284576 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-a2d6af44-6855-4f72-9e7b-62dcf9d89dc4 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:48.291964 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a2d6af44-6855-4f72-9e7b-62dcf9d89dc4 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:48.292411 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a2d6af44-6855-4f72-9e7b-62dcf9d89dc4 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:48.297242 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a2d6af44-6855-4f72-9e7b-62dcf9d89dc4 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:48.298532 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a2d6af44-6855-4f72-9e7b-62dcf9d89dc4 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:48.533783 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-a2d6af44-6855-4f72-9e7b-62dcf9d89dc4 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:48.542842 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-a2d6af44-6855-4f72-9e7b-62dcf9d89dc4 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1521 microversion: 2.1 time: 0.266124 Jun 07 22:04:48.543748 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 139/296] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:48 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1521 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:48.775842 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-e8d04935-aad2-46ea-8a4c-cf7157b9b6c3 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:48.777204 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-e8d04935-aad2-46ea-8a4c-cf7157b9b6c3 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] [instance: b6a3577d-4aaf-4947-95c1-873076371ae7] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:48.784521 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e8d04935-aad2-46ea-8a4c-cf7157b9b6c3 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:48.785202 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e8d04935-aad2-46ea-8a4c-cf7157b9b6c3 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:48.786124 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e8d04935-aad2-46ea-8a4c-cf7157b9b6c3 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:48.786753 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e8d04935-aad2-46ea-8a4c-cf7157b9b6c3 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:48.943038 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-e8d04935-aad2-46ea-8a4c-cf7157b9b6c3 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1378a898f9534635857e5958d32f00c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8d5b4fdf9a48a296359e167017123f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:48.952028 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-e8d04935-aad2-46ea-8a4c-cf7157b9b6c3 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] 10.222.0.13 "GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7" status: 200 len: 1554 microversion: 2.1 time: 0.179978 Jun 07 22:04:48.952598 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 158/297] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:48 2022] GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7 => generated 1554 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:49.029772 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-eebdf1dd-87e0-467e-8e0e-4b7f23605628 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:49.030389 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-eebdf1dd-87e0-467e-8e0e-4b7f23605628 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] [instance: 4d0577c2-268e-4615-a373-379b4979836d] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:49.036361 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-eebdf1dd-87e0-467e-8e0e-4b7f23605628 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:49.036839 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-eebdf1dd-87e0-467e-8e0e-4b7f23605628 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:49.037548 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-eebdf1dd-87e0-467e-8e0e-4b7f23605628 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:49.037982 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-eebdf1dd-87e0-467e-8e0e-4b7f23605628 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:49.118097 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-eebdf1dd-87e0-467e-8e0e-4b7f23605628 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03864707f284a14ad9726c4023f32b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f240f9b198124b58826697af9f8ab205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:49.126827 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-eebdf1dd-87e0-467e-8e0e-4b7f23605628 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] 10.222.0.13 "GET /compute/v2.1/servers/4d0577c2-268e-4615-a373-379b4979836d" status: 200 len: 1273 microversion: 2.1 time: 0.101516 Jun 07 22:04:49.127414 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 140/298] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:49 2022] GET /compute/v2.1/servers/4d0577c2-268e-4615-a373-379b4979836d => generated 1273 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:49.233849 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-0fa23480-425c-4c35-9f59-a63b3ef3bce5 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:49.234525 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-0fa23480-425c-4c35-9f59-a63b3ef3bce5 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] [instance: 8f7f3be8-21d5-446e-9ee5-0caa7c97a68a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:49.240784 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-0fa23480-425c-4c35-9f59-a63b3ef3bce5 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:49.241325 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-0fa23480-425c-4c35-9f59-a63b3ef3bce5 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:49.242171 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-0fa23480-425c-4c35-9f59-a63b3ef3bce5 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:49.242697 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-0fa23480-425c-4c35-9f59-a63b3ef3bce5 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:49.393649 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-0fa23480-425c-4c35-9f59-a63b3ef3bce5 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4fc7744b3d4e5fb6e281fcc90cef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b84dd581fc4e9499cfecbb7242e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:49.403514 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-0fa23480-425c-4c35-9f59-a63b3ef3bce5 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] 10.222.0.13 "GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a" status: 200 len: 1318 microversion: 2.1 time: 0.173404 Jun 07 22:04:49.404331 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 159/299] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:49 2022] GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:49.560693 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-b031906d-425f-421f-a19a-a85a293df208 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:49.561302 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-b031906d-425f-421f-a19a-a85a293df208 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:49.567357 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-b031906d-425f-421f-a19a-a85a293df208 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:49.578904 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-b031906d-425f-421f-a19a-a85a293df208 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:49.579764 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-b031906d-425f-421f-a19a-a85a293df208 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:49.580210 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-b031906d-425f-421f-a19a-a85a293df208 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:49.726939 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-b031906d-425f-421f-a19a-a85a293df208 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:49.734487 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-b031906d-425f-421f-a19a-a85a293df208 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1521 microversion: 2.1 time: 0.177525 Jun 07 22:04:49.735059 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 141/300] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:49 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:49.969411 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-e4d3845a-5694-4cba-a630-dbf573c2d577 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:49.970016 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-e4d3845a-5694-4cba-a630-dbf573c2d577 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] [instance: b6a3577d-4aaf-4947-95c1-873076371ae7] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:49.977022 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e4d3845a-5694-4cba-a630-dbf573c2d577 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:49.977629 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e4d3845a-5694-4cba-a630-dbf573c2d577 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:49.978394 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e4d3845a-5694-4cba-a630-dbf573c2d577 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:49.978829 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e4d3845a-5694-4cba-a630-dbf573c2d577 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:50.145506 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-dbbdbd73-3b5a-4903-8cda-3a3e6da8cf8a tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:50.147557 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-dbbdbd73-3b5a-4903-8cda-3a3e6da8cf8a tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] [instance: 4d0577c2-268e-4615-a373-379b4979836d] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:50.166125 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-dbbdbd73-3b5a-4903-8cda-3a3e6da8cf8a tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:50.167440 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-dbbdbd73-3b5a-4903-8cda-3a3e6da8cf8a tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:50.174645 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-dbbdbd73-3b5a-4903-8cda-3a3e6da8cf8a tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:50.179551 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-dbbdbd73-3b5a-4903-8cda-3a3e6da8cf8a tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:50.292347 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-e4d3845a-5694-4cba-a630-dbf573c2d577 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1378a898f9534635857e5958d32f00c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8d5b4fdf9a48a296359e167017123f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:50.309995 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-e4d3845a-5694-4cba-a630-dbf573c2d577 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] 10.222.0.13 "GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7" status: 200 len: 1554 microversion: 2.1 time: 0.344368 Jun 07 22:04:50.311005 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 160/301] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:49 2022] GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7 => generated 1554 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:50.357428 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [req-15b4fab0-dd8b-45a3-87ef-798e46239616 req-ec50bf28-1e1f-4407-be43-cca5ac985a08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6a3577d-4aaf-4947-95c1-873076371ae7", "name": "network-vif-unplugged", "status": "completed", "tag": "013cdc82-ff69-4ef3-8efc-580732459589"}]} {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:04:50.372865 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-15b4fab0-dd8b-45a3-87ef-798e46239616 req-ec50bf28-1e1f-4407-be43-cca5ac985a08 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:50.373312 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-15b4fab0-dd8b-45a3-87ef-798e46239616 req-ec50bf28-1e1f-4407-be43-cca5ac985a08 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:50.396154 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.compute.server_external_events [req-15b4fab0-dd8b-45a3-87ef-798e46239616 req-ec50bf28-1e1f-4407-be43-cca5ac985a08 service nova] Creating event network-vif-unplugged:013cdc82-ff69-4ef3-8efc-580732459589 for instance b6a3577d-4aaf-4947-95c1-873076371ae7 on hv-cinder-83552 Jun 07 22:04:50.410238 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [req-15b4fab0-dd8b-45a3-87ef-798e46239616 req-ec50bf28-1e1f-4407-be43-cca5ac985a08 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058687 Jun 07 22:04:50.411178 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-dbbdbd73-3b5a-4903-8cda-3a3e6da8cf8a tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03864707f284a14ad9726c4023f32b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f240f9b198124b58826697af9f8ab205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:50.413131 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 161/302] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:04:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 22:04:50.424845 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-dbbdbd73-3b5a-4903-8cda-3a3e6da8cf8a tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] 10.222.0.13 "GET /compute/v2.1/servers/4d0577c2-268e-4615-a373-379b4979836d" status: 200 len: 1273 microversion: 2.1 time: 0.284405 Jun 07 22:04:50.425432 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 142/303] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:50 2022] GET /compute/v2.1/servers/4d0577c2-268e-4615-a373-379b4979836d => generated 1273 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:50.432897 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-578e51d4-fbdc-460a-ab87-070f443474cc tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:50.433958 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-578e51d4-fbdc-460a-ab87-070f443474cc tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] [instance: 8f7f3be8-21d5-446e-9ee5-0caa7c97a68a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:50.443040 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-578e51d4-fbdc-460a-ab87-070f443474cc tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:50.443860 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-578e51d4-fbdc-460a-ab87-070f443474cc tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:50.445400 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-578e51d4-fbdc-460a-ab87-070f443474cc tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:50.446457 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-578e51d4-fbdc-460a-ab87-070f443474cc tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:50.655574 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-578e51d4-fbdc-460a-ab87-070f443474cc tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4fc7744b3d4e5fb6e281fcc90cef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b84dd581fc4e9499cfecbb7242e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:50.667476 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-578e51d4-fbdc-460a-ab87-070f443474cc tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] 10.222.0.13 "GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a" status: 200 len: 1318 microversion: 2.1 time: 0.243193 Jun 07 22:04:50.668507 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 162/304] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:50 2022] GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a => generated 1318 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:50.752812 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-4a733fe0-ccc4-47d0-9cb2-2799f71c708a tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:50.753847 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-4a733fe0-ccc4-47d0-9cb2-2799f71c708a tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:50.761788 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4a733fe0-ccc4-47d0-9cb2-2799f71c708a tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:50.762454 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4a733fe0-ccc4-47d0-9cb2-2799f71c708a tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:50.763456 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4a733fe0-ccc4-47d0-9cb2-2799f71c708a tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:50.764087 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4a733fe0-ccc4-47d0-9cb2-2799f71c708a tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:51.329034 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-2c9d6723-c13b-4cd2-909a-e7e88f0a9828 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:51.330142 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-2c9d6723-c13b-4cd2-909a-e7e88f0a9828 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] [instance: b6a3577d-4aaf-4947-95c1-873076371ae7] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:51.338224 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-2c9d6723-c13b-4cd2-909a-e7e88f0a9828 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:51.338677 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-2c9d6723-c13b-4cd2-909a-e7e88f0a9828 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:51.339606 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-2c9d6723-c13b-4cd2-909a-e7e88f0a9828 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:51.340337 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-2c9d6723-c13b-4cd2-909a-e7e88f0a9828 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:51.390198 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-4a733fe0-ccc4-47d0-9cb2-2799f71c708a tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:51.400168 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-4a733fe0-ccc4-47d0-9cb2-2799f71c708a tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1521 microversion: 2.1 time: 0.651430 Jun 07 22:04:51.410435 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 143/305] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:50 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1521 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:51.411081 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-2c9d6723-c13b-4cd2-909a-e7e88f0a9828 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1378a898f9534635857e5958d32f00c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8d5b4fdf9a48a296359e167017123f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:51.415738 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [req-1d7a2505-92cf-4a8d-98c6-8a7c70238d84 req-65e6f801-ef19-4b99-afc0-df80ebb30995 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6a3577d-4aaf-4947-95c1-873076371ae7", "name": "network-vif-deleted", "tag": "013cdc82-ff69-4ef3-8efc-580732459589"}]} {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:04:51.421065 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-2c9d6723-c13b-4cd2-909a-e7e88f0a9828 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] 10.222.0.13 "GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7" status: 200 len: 1512 microversion: 2.1 time: 0.095877 Jun 07 22:04:51.421829 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 163/306] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:51 2022] GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7 => generated 1512 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:04:51.428714 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [req-1d7a2505-92cf-4a8d-98c6-8a7c70238d84 req-65e6f801-ef19-4b99-afc0-df80ebb30995 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:51.428714 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [req-1d7a2505-92cf-4a8d-98c6-8a7c70238d84 req-65e6f801-ef19-4b99-afc0-df80ebb30995 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:51.437508 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.compute.server_external_events [req-1d7a2505-92cf-4a8d-98c6-8a7c70238d84 req-65e6f801-ef19-4b99-afc0-df80ebb30995 service nova] Creating event network-vif-deleted:013cdc82-ff69-4ef3-8efc-580732459589 for instance b6a3577d-4aaf-4947-95c1-873076371ae7 on hv-cinder-83552 Jun 07 22:04:51.446051 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-328e8073-df0c-4898-9808-265d2ad15fcf tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:51.447631 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-328e8073-df0c-4898-9808-265d2ad15fcf tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] [instance: 4d0577c2-268e-4615-a373-379b4979836d] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:51.452687 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [req-1d7a2505-92cf-4a8d-98c6-8a7c70238d84 req-65e6f801-ef19-4b99-afc0-df80ebb30995 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040312 Jun 07 22:04:51.453514 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 144/307] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:04:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:04:51.455593 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-328e8073-df0c-4898-9808-265d2ad15fcf tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:51.456106 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-328e8073-df0c-4898-9808-265d2ad15fcf tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:51.456881 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-328e8073-df0c-4898-9808-265d2ad15fcf tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:51.457313 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-328e8073-df0c-4898-9808-265d2ad15fcf tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:51.520597 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-328e8073-df0c-4898-9808-265d2ad15fcf tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03864707f284a14ad9726c4023f32b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f240f9b198124b58826697af9f8ab205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:51.528081 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-328e8073-df0c-4898-9808-265d2ad15fcf tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] 10.222.0.13 "GET /compute/v2.1/servers/4d0577c2-268e-4615-a373-379b4979836d" status: 200 len: 1273 microversion: 2.1 time: 0.088383 Jun 07 22:04:51.528680 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 164/308] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:51 2022] GET /compute/v2.1/servers/4d0577c2-268e-4615-a373-379b4979836d => generated 1273 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:51.686478 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-7c0eab79-9df5-4855-b9d3-491caddb99e5 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:51.688760 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-7c0eab79-9df5-4855-b9d3-491caddb99e5 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] [instance: 8f7f3be8-21d5-446e-9ee5-0caa7c97a68a] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:51.702291 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-7c0eab79-9df5-4855-b9d3-491caddb99e5 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:51.703218 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-7c0eab79-9df5-4855-b9d3-491caddb99e5 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:51.704219 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-7c0eab79-9df5-4855-b9d3-491caddb99e5 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:51.705546 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-7c0eab79-9df5-4855-b9d3-491caddb99e5 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:51.949200 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-7c0eab79-9df5-4855-b9d3-491caddb99e5 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4fc7744b3d4e5fb6e281fcc90cef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b84dd581fc4e9499cfecbb7242e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:51.956813 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-7c0eab79-9df5-4855-b9d3-491caddb99e5 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] 10.222.0.13 "GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a" status: 200 len: 1318 microversion: 2.1 time: 0.274624 Jun 07 22:04:51.963256 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 145/309] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:51 2022] GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a => generated 1318 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:52.418523 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-d0a14f84-be17-48a8-b389-01a5a6578a46 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:52.419601 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-d0a14f84-be17-48a8-b389-01a5a6578a46 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:52.436697 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-d0a14f84-be17-48a8-b389-01a5a6578a46 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:52.437470 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-d0a14f84-be17-48a8-b389-01a5a6578a46 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:52.438608 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-d0a14f84-be17-48a8-b389-01a5a6578a46 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:52.439667 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-d0a14f84-be17-48a8-b389-01a5a6578a46 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:52.442419 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-b9d6e4d2-d7f6-44f7-b5bf-eca1aae5ba24 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:52.443695 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-b9d6e4d2-d7f6-44f7-b5bf-eca1aae5ba24 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] [instance: b6a3577d-4aaf-4947-95c1-873076371ae7] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:52.454032 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-b9d6e4d2-d7f6-44f7-b5bf-eca1aae5ba24 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:52.454779 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-b9d6e4d2-d7f6-44f7-b5bf-eca1aae5ba24 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:52.455737 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-b9d6e4d2-d7f6-44f7-b5bf-eca1aae5ba24 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:52.456320 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-b9d6e4d2-d7f6-44f7-b5bf-eca1aae5ba24 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:52.559178 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-b9d6e4d2-d7f6-44f7-b5bf-eca1aae5ba24 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1378a898f9534635857e5958d32f00c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8d5b4fdf9a48a296359e167017123f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:52.568170 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-b9d6e4d2-d7f6-44f7-b5bf-eca1aae5ba24 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] 10.222.0.13 "GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7" status: 200 len: 1345 microversion: 2.1 time: 0.132099 Jun 07 22:04:52.569086 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 146/310] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:52 2022] GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7 => generated 1345 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:04:52.578143 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-78918c31-46eb-4f4d-bc91-46daf85e9a23 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:52.578755 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-78918c31-46eb-4f4d-bc91-46daf85e9a23 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] [instance: 4d0577c2-268e-4615-a373-379b4979836d] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:52.588904 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-78918c31-46eb-4f4d-bc91-46daf85e9a23 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:52.589461 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-78918c31-46eb-4f4d-bc91-46daf85e9a23 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:52.590302 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-78918c31-46eb-4f4d-bc91-46daf85e9a23 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:52.590971 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-78918c31-46eb-4f4d-bc91-46daf85e9a23 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:52.685725 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-d0a14f84-be17-48a8-b389-01a5a6578a46 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:52.694465 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-d0a14f84-be17-48a8-b389-01a5a6578a46 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1521 microversion: 2.1 time: 0.281016 Jun 07 22:04:52.701134 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 165/311] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:52 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1521 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:52.711103 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [req-20acb27e-d9ac-43e8-88a7-a6925efd6426 req-0d93a31e-622c-499e-a3d8-1eb2e73597a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f7f3be8-21d5-446e-9ee5-0caa7c97a68a", "name": "network-vif-plugged", "status": "completed", "tag": "68d9825d-4732-4ff9-baca-ebb1dff29654"}]} {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:04:52.722715 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-20acb27e-d9ac-43e8-88a7-a6925efd6426 req-0d93a31e-622c-499e-a3d8-1eb2e73597a9 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:52.723168 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-20acb27e-d9ac-43e8-88a7-a6925efd6426 req-0d93a31e-622c-499e-a3d8-1eb2e73597a9 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:52.736159 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.compute.server_external_events [req-20acb27e-d9ac-43e8-88a7-a6925efd6426 req-0d93a31e-622c-499e-a3d8-1eb2e73597a9 service nova] Creating event network-vif-plugged:68d9825d-4732-4ff9-baca-ebb1dff29654 for instance 8f7f3be8-21d5-446e-9ee5-0caa7c97a68a on hv-cinder-83552 Jun 07 22:04:52.743356 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [req-20acb27e-d9ac-43e8-88a7-a6925efd6426 req-0d93a31e-622c-499e-a3d8-1eb2e73597a9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035687 Jun 07 22:04:52.744344 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 166/312] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:04:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:04:52.833928 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-78918c31-46eb-4f4d-bc91-46daf85e9a23 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03864707f284a14ad9726c4023f32b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f240f9b198124b58826697af9f8ab205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:52.842509 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-78918c31-46eb-4f4d-bc91-46daf85e9a23 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] 10.222.0.13 "GET /compute/v2.1/servers/4d0577c2-268e-4615-a373-379b4979836d" status: 200 len: 1315 microversion: 2.1 time: 0.272310 Jun 07 22:04:52.843176 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 147/313] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:52 2022] GET /compute/v2.1/servers/4d0577c2-268e-4615-a373-379b4979836d => generated 1315 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:52.976432 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-a7764623-0667-4d7c-acc7-051757d755e9 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:52.977159 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-a7764623-0667-4d7c-acc7-051757d755e9 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] [instance: 8f7f3be8-21d5-446e-9ee5-0caa7c97a68a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:52.983342 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a7764623-0667-4d7c-acc7-051757d755e9 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:52.983810 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a7764623-0667-4d7c-acc7-051757d755e9 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:52.984557 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a7764623-0667-4d7c-acc7-051757d755e9 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:52.985002 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a7764623-0667-4d7c-acc7-051757d755e9 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:53.126038 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-a7764623-0667-4d7c-acc7-051757d755e9 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4fc7744b3d4e5fb6e281fcc90cef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b84dd581fc4e9499cfecbb7242e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:53.134187 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-a7764623-0667-4d7c-acc7-051757d755e9 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] 10.222.0.13 "GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a" status: 200 len: 1318 microversion: 2.1 time: 0.161935 Jun 07 22:04:53.135020 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 167/314] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:52 2022] GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:53.476818 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [req-174fca56-2077-403d-9dbf-7f50d387b2f7 req-b70f6d1d-04db-4695-905c-f17b9e4a4deb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d0577c2-268e-4615-a373-379b4979836d", "tag": "6ba72632-5769-4f6c-aa4c-7db96324a52a"}]} {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:04:53.485470 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [req-174fca56-2077-403d-9dbf-7f50d387b2f7 req-b70f6d1d-04db-4695-905c-f17b9e4a4deb service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:53.485982 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [req-174fca56-2077-403d-9dbf-7f50d387b2f7 req-b70f6d1d-04db-4695-905c-f17b9e4a4deb service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:53.497876 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.compute.server_external_events [req-174fca56-2077-403d-9dbf-7f50d387b2f7 req-b70f6d1d-04db-4695-905c-f17b9e4a4deb service nova] Creating event network-changed:6ba72632-5769-4f6c-aa4c-7db96324a52a for instance 4d0577c2-268e-4615-a373-379b4979836d on hv-cinder-83552 Jun 07 22:04:53.502941 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [req-174fca56-2077-403d-9dbf-7f50d387b2f7 req-b70f6d1d-04db-4695-905c-f17b9e4a4deb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030863 Jun 07 22:04:53.503630 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 148/315] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:04:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:04:53.586212 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-af9d8916-40d0-4922-9ffa-e08b0bcc711f tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:53.586974 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-af9d8916-40d0-4922-9ffa-e08b0bcc711f tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] [instance: b6a3577d-4aaf-4947-95c1-873076371ae7] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:53.594818 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-af9d8916-40d0-4922-9ffa-e08b0bcc711f tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:53.595269 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-af9d8916-40d0-4922-9ffa-e08b0bcc711f tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:53.596238 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-af9d8916-40d0-4922-9ffa-e08b0bcc711f tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:53.596513 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-af9d8916-40d0-4922-9ffa-e08b0bcc711f tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:53.611466 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.wsgi [None req-af9d8916-40d0-4922-9ffa-e08b0bcc711f tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] HTTP exception thrown: Instance b6a3577d-4aaf-4947-95c1-873076371ae7 could not be found. Jun 07 22:04:53.616102 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-af9d8916-40d0-4922-9ffa-e08b0bcc711f tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Request method failure captured: Jun 07 22:04:53.616102 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: request: GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7 HTTP/1.1 Jun 07 22:04:53.616102 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Accept: application/json Jun 07 22:04:53.616102 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Accept-Encoding: identity Jun 07 22:04:53.616102 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Connection: close Jun 07 22:04:53.616102 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Content-Length: 0 Jun 07 22:04:53.616102 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Content-Type: application/json Jun 07 22:04:53.616102 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Host: 10.222.0.13 Jun 07 22:04:53.616102 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Openstack-System-Scope: None Jun 07 22:04:53.616102 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: User-Agent: python-urllib3/1.26.9 Jun 07 22:04:53.616102 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Auth-Token: gAAAAABin8sZg2NwkZHg4ZYfrxb80B5D0hFxsk_cyJ8nHLGUBUD5sn3voiQeZrjA0rLNIgayLX6n9-7dabde4mQ7OMKuM__vmGJCD7sIzRhhppCUskglai-DjGb9Hhsm4a2WBMTuNIITmh5MkErP0L0SXOz4QXqUru4ErzyFc8v0yx7iPpNDnZs Jun 07 22:04:53.616102 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Domain-Id: None Jun 07 22:04:53.616102 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Domain-Name: None Jun 07 22:04:53.616102 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Identity-Status: Confirmed Jun 07 22:04:53.616102 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Is-Admin-Project: True Jun 07 22:04:53.616102 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Domain-Id: default Jun 07 22:04:53.616102 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Domain-Name: Default Jun 07 22:04:53.616102 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Id: 7e8d5b4fdf9a48a296359e167017123f Jun 07 22:04:53.616102 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Name: tempest-DeleteServersTestJSON-343950354 Jun 07 22:04:53.616102 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Role: member,reader Jun 07 22:04:53.616102 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Roles: member,reader Jun 07 22:04:53.617383 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7e8d5b4fdf9a48a296359e167017123f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7e8d5b4fdf9a48a296359e167017123f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7e8d5b4fdf9a48a296359e167017123f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7e8d5b4fdf9a48a296359e167017123f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}] Jun 07 22:04:53.617383 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant: tempest-DeleteServersTestJSON-343950354 Jun 07 22:04:53.617383 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant-Id: 7e8d5b4fdf9a48a296359e167017123f Jun 07 22:04:53.617383 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant-Name: tempest-DeleteServersTestJSON-343950354 Jun 07 22:04:53.617383 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User: tempest-DeleteServersTestJSON-343950354-project Jun 07 22:04:53.617383 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Domain-Id: default Jun 07 22:04:53.617383 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Domain-Name: Default Jun 07 22:04:53.617383 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Id: 1378a898f9534635857e5958d32f00c5 Jun 07 22:04:53.617383 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Name: tempest-DeleteServersTestJSON-343950354-project Jun 07 22:04:53.617383 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: method: > Jun 07 22:04:53.617383 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: exception: Instance b6a3577d-4aaf-4947-95c1-873076371ae7 could not be found. Jun 07 22:04:53.617383 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: action_args: {'id': 'b6a3577d-4aaf-4947-95c1-873076371ae7'} Jun 07 22:04:53.618590 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 22:04:53.618590 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:04:53.618590 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 22:04:53.618590 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 22:04:53.618590 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 22:04:53.618590 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 22:04:53.618590 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 22:04:53.618590 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 22:04:53.618590 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 22:04:53.618590 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 22:04:53.618590 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6a3577d-4aaf-4947-95c1-873076371ae7 could not be found. Jun 07 22:04:53.618590 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:04:53.618590 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:04:53.618590 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:04:53.618590 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:04:53.618590 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:04:53.618590 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:04:53.618590 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 22:04:53.618590 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 22:04:53.618590 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 22:04:53.619789 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 22:04:53.619789 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 22:04:53.619789 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 22:04:53.619789 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 22:04:53.619789 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 22:04:53.619789 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 22:04:53.619789 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 22:04:53.619789 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6a3577d-4aaf-4947-95c1-873076371ae7 could not be found. Jun 07 22:04:53.619789 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:04:53.619789 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:04:53.619789 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:04:53.619789 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:04:53.619789 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:04:53.619789 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:04:53.619789 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 22:04:53.619789 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 22:04:53.619789 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6a3577d-4aaf-4947-95c1-873076371ae7 could not be found. Jun 07 22:04:53.619789 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:04:53.620801 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-af9d8916-40d0-4922-9ffa-e08b0bcc711f tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Returning 404 to user: Instance b6a3577d-4aaf-4947-95c1-873076371ae7 could not be found. {{(pid=117971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 22:04:53.620801 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-af9d8916-40d0-4922-9ffa-e08b0bcc711f tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] 10.222.0.13 "GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7" status: 404 len: 111 microversion: 2.1 time: 0.035458 Jun 07 22:04:53.620801 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 168/316] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:53 2022] GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 22:04:53.717911 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-8b995725-f34d-479e-b742-987997e32de7 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:53.718673 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-8b995725-f34d-479e-b742-987997e32de7 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:53.726177 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-8b995725-f34d-479e-b742-987997e32de7 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:53.726619 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-8b995725-f34d-479e-b742-987997e32de7 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:53.727652 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-8b995725-f34d-479e-b742-987997e32de7 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:53.728134 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-8b995725-f34d-479e-b742-987997e32de7 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:53.731461 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-a33a7907-4589-4fda-8c40-310a7e405b50 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:53.732394 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-a33a7907-4589-4fda-8c40-310a7e405b50 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] [instance: b6a3577d-4aaf-4947-95c1-873076371ae7] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:53.734531 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:04:53.739685 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a33a7907-4589-4fda-8c40-310a7e405b50 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:53.740122 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a33a7907-4589-4fda-8c40-310a7e405b50 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:53.740893 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a33a7907-4589-4fda-8c40-310a7e405b50 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:53.741322 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a33a7907-4589-4fda-8c40-310a7e405b50 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:53.756019 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.wsgi [None req-a33a7907-4589-4fda-8c40-310a7e405b50 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] HTTP exception thrown: Instance b6a3577d-4aaf-4947-95c1-873076371ae7 could not be found. Jun 07 22:04:53.757786 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-a33a7907-4589-4fda-8c40-310a7e405b50 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Request method failure captured: Jun 07 22:04:53.757786 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: request: GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7/os-volume_attachments HTTP/1.1 Jun 07 22:04:53.757786 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Accept: application/json Jun 07 22:04:53.757786 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Accept-Encoding: identity Jun 07 22:04:53.757786 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Connection: close Jun 07 22:04:53.757786 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Content-Length: 0 Jun 07 22:04:53.757786 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Content-Type: application/json Jun 07 22:04:53.757786 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Host: 10.222.0.13 Jun 07 22:04:53.757786 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Openstack-System-Scope: None Jun 07 22:04:53.757786 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: User-Agent: python-urllib3/1.26.9 Jun 07 22:04:53.757786 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Auth-Token: gAAAAABin8sZg2NwkZHg4ZYfrxb80B5D0hFxsk_cyJ8nHLGUBUD5sn3voiQeZrjA0rLNIgayLX6n9-7dabde4mQ7OMKuM__vmGJCD7sIzRhhppCUskglai-DjGb9Hhsm4a2WBMTuNIITmh5MkErP0L0SXOz4QXqUru4ErzyFc8v0yx7iPpNDnZs Jun 07 22:04:53.757786 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Domain-Id: None Jun 07 22:04:53.757786 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Domain-Name: None Jun 07 22:04:53.757786 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Identity-Status: Confirmed Jun 07 22:04:53.757786 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Is-Admin-Project: True Jun 07 22:04:53.757786 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Domain-Id: default Jun 07 22:04:53.757786 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Domain-Name: Default Jun 07 22:04:53.757786 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Id: 7e8d5b4fdf9a48a296359e167017123f Jun 07 22:04:53.757786 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Name: tempest-DeleteServersTestJSON-343950354 Jun 07 22:04:53.757786 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Role: member,reader Jun 07 22:04:53.757786 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Roles: member,reader Jun 07 22:04:53.759941 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7e8d5b4fdf9a48a296359e167017123f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7e8d5b4fdf9a48a296359e167017123f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7e8d5b4fdf9a48a296359e167017123f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7e8d5b4fdf9a48a296359e167017123f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}] Jun 07 22:04:53.759941 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant: tempest-DeleteServersTestJSON-343950354 Jun 07 22:04:53.759941 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant-Id: 7e8d5b4fdf9a48a296359e167017123f Jun 07 22:04:53.759941 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant-Name: tempest-DeleteServersTestJSON-343950354 Jun 07 22:04:53.759941 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User: tempest-DeleteServersTestJSON-343950354-project Jun 07 22:04:53.759941 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Domain-Id: default Jun 07 22:04:53.759941 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Domain-Name: Default Jun 07 22:04:53.759941 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Id: 1378a898f9534635857e5958d32f00c5 Jun 07 22:04:53.759941 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Name: tempest-DeleteServersTestJSON-343950354-project Jun 07 22:04:53.759941 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: method: > Jun 07 22:04:53.759941 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: exception: Instance b6a3577d-4aaf-4947-95c1-873076371ae7 could not be found. Jun 07 22:04:53.759941 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: action_args: {'server_id': 'b6a3577d-4aaf-4947-95c1-873076371ae7'} Jun 07 22:04:53.760699 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 22:04:53.760699 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:04:53.760699 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 22:04:53.760699 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 22:04:53.760699 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 22:04:53.760699 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 22:04:53.760699 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 22:04:53.760699 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 22:04:53.760699 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 22:04:53.760699 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 22:04:53.760699 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6a3577d-4aaf-4947-95c1-873076371ae7 could not be found. Jun 07 22:04:53.760699 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:04:53.760699 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:04:53.760699 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:04:53.760699 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:04:53.760699 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:04:53.760699 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:04:53.760699 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 22:04:53.760699 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 22:04:53.760699 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 22:04:53.761732 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 22:04:53.761732 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 07 22:04:53.761732 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 22:04:53.761732 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 07 22:04:53.761732 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 22:04:53.761732 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 07 22:04:53.761732 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 07 22:04:53.761732 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 22:04:53.761732 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 22:04:53.761732 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6a3577d-4aaf-4947-95c1-873076371ae7 could not be found. Jun 07 22:04:53.761732 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:04:53.761732 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:04:53.761732 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:04:53.761732 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:04:53.761732 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:04:53.761732 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:04:53.761732 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 22:04:53.761732 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 22:04:53.761732 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6a3577d-4aaf-4947-95c1-873076371ae7 could not be found. Jun 07 22:04:53.761732 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:04:53.764706 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-a33a7907-4589-4fda-8c40-310a7e405b50 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Returning 404 to user: Instance b6a3577d-4aaf-4947-95c1-873076371ae7 could not be found. {{(pid=117971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 22:04:53.765760 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-a33a7907-4589-4fda-8c40-310a7e405b50 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] 10.222.0.13 "GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.045614 Jun 07 22:04:53.766318 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 169/317] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jun 7 22:04:53 2022] GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7/os-volume_attachments => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 07 22:04:53.862425 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-c1870ea3-b153-42f6-89ba-2e5ab318653c tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:53.863421 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-c1870ea3-b153-42f6-89ba-2e5ab318653c tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] [instance: 4d0577c2-268e-4615-a373-379b4979836d] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:53.871823 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c1870ea3-b153-42f6-89ba-2e5ab318653c tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:53.872659 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c1870ea3-b153-42f6-89ba-2e5ab318653c tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:53.873938 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c1870ea3-b153-42f6-89ba-2e5ab318653c tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:53.874718 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c1870ea3-b153-42f6-89ba-2e5ab318653c tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:53.934876 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-8b995725-f34d-479e-b742-987997e32de7 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:53.947138 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-8b995725-f34d-479e-b742-987997e32de7 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1521 microversion: 2.1 time: 0.233441 Jun 07 22:04:53.947837 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 149/318] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:53 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:54.063309 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-c1870ea3-b153-42f6-89ba-2e5ab318653c tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03864707f284a14ad9726c4023f32b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f240f9b198124b58826697af9f8ab205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:54.071358 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-c1870ea3-b153-42f6-89ba-2e5ab318653c tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] 10.222.0.13 "GET /compute/v2.1/servers/4d0577c2-268e-4615-a373-379b4979836d" status: 200 len: 1315 microversion: 2.1 time: 0.214379 Jun 07 22:04:54.072157 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 170/319] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:53 2022] GET /compute/v2.1/servers/4d0577c2-268e-4615-a373-379b4979836d => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:04:54.151542 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-63f71a0d-534c-47d4-ade0-0d1deb6873c2 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:54.152275 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-63f71a0d-534c-47d4-ade0-0d1deb6873c2 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] [instance: 8f7f3be8-21d5-446e-9ee5-0caa7c97a68a] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:54.158569 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-63f71a0d-534c-47d4-ade0-0d1deb6873c2 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:54.159110 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-63f71a0d-534c-47d4-ade0-0d1deb6873c2 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:54.159994 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-63f71a0d-534c-47d4-ade0-0d1deb6873c2 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:54.160531 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-63f71a0d-534c-47d4-ade0-0d1deb6873c2 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:54.300718 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-63f71a0d-534c-47d4-ade0-0d1deb6873c2 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4fc7744b3d4e5fb6e281fcc90cef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b84dd581fc4e9499cfecbb7242e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:54.308216 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-63f71a0d-534c-47d4-ade0-0d1deb6873c2 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] 10.222.0.13 "GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a" status: 200 len: 1318 microversion: 2.1 time: 0.161399 Jun 07 22:04:54.308776 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 150/320] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:54 2022] GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:54.964183 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-dae84bae-3f38-4bcf-a0da-4b822e9fe93b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:54.965001 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-dae84bae-3f38-4bcf-a0da-4b822e9fe93b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:54.972772 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-dae84bae-3f38-4bcf-a0da-4b822e9fe93b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:54.973236 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-dae84bae-3f38-4bcf-a0da-4b822e9fe93b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:54.974010 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-dae84bae-3f38-4bcf-a0da-4b822e9fe93b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:54.974468 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-dae84bae-3f38-4bcf-a0da-4b822e9fe93b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:55.085864 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-5ee2c8c6-0030-43bd-b21c-b7f4652db5b7 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:55.086369 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-5ee2c8c6-0030-43bd-b21c-b7f4652db5b7 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] [instance: b6a3577d-4aaf-4947-95c1-873076371ae7] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:55.088474 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_cell0:SELECT=2 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:04:55.089247 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_cell0:SELECT=8 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:04:55.095296 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-5ee2c8c6-0030-43bd-b21c-b7f4652db5b7 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:55.095845 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-5ee2c8c6-0030-43bd-b21c-b7f4652db5b7 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:55.096597 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-5ee2c8c6-0030-43bd-b21c-b7f4652db5b7 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:55.097059 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-5ee2c8c6-0030-43bd-b21c-b7f4652db5b7 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:55.107468 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-dae84bae-3f38-4bcf-a0da-4b822e9fe93b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:55.112488 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.wsgi [None req-5ee2c8c6-0030-43bd-b21c-b7f4652db5b7 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] HTTP exception thrown: Instance b6a3577d-4aaf-4947-95c1-873076371ae7 could not be found. Jun 07 22:04:55.115355 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-dae84bae-3f38-4bcf-a0da-4b822e9fe93b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1521 microversion: 2.1 time: 0.155008 Jun 07 22:04:55.115931 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 171/321] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:54 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:55.117456 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-5ee2c8c6-0030-43bd-b21c-b7f4652db5b7 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Request method failure captured: Jun 07 22:04:55.117456 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: request: DELETE /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7 HTTP/1.1 Jun 07 22:04:55.117456 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Accept: application/json Jun 07 22:04:55.117456 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Accept-Encoding: identity Jun 07 22:04:55.117456 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Connection: close Jun 07 22:04:55.117456 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Content-Length: 0 Jun 07 22:04:55.117456 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Content-Type: application/json Jun 07 22:04:55.117456 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Host: 10.222.0.13 Jun 07 22:04:55.117456 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Openstack-System-Scope: None Jun 07 22:04:55.117456 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: User-Agent: python-urllib3/1.26.9 Jun 07 22:04:55.117456 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Auth-Token: gAAAAABin8sZg2NwkZHg4ZYfrxb80B5D0hFxsk_cyJ8nHLGUBUD5sn3voiQeZrjA0rLNIgayLX6n9-7dabde4mQ7OMKuM__vmGJCD7sIzRhhppCUskglai-DjGb9Hhsm4a2WBMTuNIITmh5MkErP0L0SXOz4QXqUru4ErzyFc8v0yx7iPpNDnZs Jun 07 22:04:55.117456 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Domain-Id: None Jun 07 22:04:55.117456 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Domain-Name: None Jun 07 22:04:55.117456 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Identity-Status: Confirmed Jun 07 22:04:55.117456 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Is-Admin-Project: True Jun 07 22:04:55.117456 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Domain-Id: default Jun 07 22:04:55.117456 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Domain-Name: Default Jun 07 22:04:55.117456 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Id: 7e8d5b4fdf9a48a296359e167017123f Jun 07 22:04:55.117456 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Name: tempest-DeleteServersTestJSON-343950354 Jun 07 22:04:55.117456 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Role: member,reader Jun 07 22:04:55.117456 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Roles: member,reader Jun 07 22:04:55.119296 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7e8d5b4fdf9a48a296359e167017123f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7e8d5b4fdf9a48a296359e167017123f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7e8d5b4fdf9a48a296359e167017123f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7e8d5b4fdf9a48a296359e167017123f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}] Jun 07 22:04:55.119296 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Tenant: tempest-DeleteServersTestJSON-343950354 Jun 07 22:04:55.119296 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Tenant-Id: 7e8d5b4fdf9a48a296359e167017123f Jun 07 22:04:55.119296 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Tenant-Name: tempest-DeleteServersTestJSON-343950354 Jun 07 22:04:55.119296 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User: tempest-DeleteServersTestJSON-343950354-project Jun 07 22:04:55.119296 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Domain-Id: default Jun 07 22:04:55.119296 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Domain-Name: Default Jun 07 22:04:55.119296 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Id: 1378a898f9534635857e5958d32f00c5 Jun 07 22:04:55.119296 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Name: tempest-DeleteServersTestJSON-343950354-project Jun 07 22:04:55.119296 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: method: > Jun 07 22:04:55.119296 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: exception: Instance b6a3577d-4aaf-4947-95c1-873076371ae7 could not be found. Jun 07 22:04:55.119296 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: action_args: {'id': 'b6a3577d-4aaf-4947-95c1-873076371ae7'} Jun 07 22:04:55.119988 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 22:04:55.119988 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:04:55.119988 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 22:04:55.119988 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 22:04:55.119988 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 22:04:55.119988 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 22:04:55.119988 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 22:04:55.119988 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 22:04:55.119988 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 22:04:55.119988 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 22:04:55.119988 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6a3577d-4aaf-4947-95c1-873076371ae7 could not be found. Jun 07 22:04:55.119988 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:04:55.119988 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:04:55.119988 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:04:55.119988 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:04:55.119988 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:04:55.119988 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:04:55.119988 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 22:04:55.119988 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 22:04:55.119988 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 22:04:55.124090 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 22:04:55.124090 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 22:04:55.124090 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 22:04:55.124090 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 22:04:55.124090 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 22:04:55.124090 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 22:04:55.124090 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 22:04:55.124090 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 22:04:55.124090 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 22:04:55.124090 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6a3577d-4aaf-4947-95c1-873076371ae7 could not be found. Jun 07 22:04:55.124090 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:04:55.124090 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:04:55.124090 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:04:55.124090 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:04:55.124090 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:04:55.124090 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:04:55.124090 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 22:04:55.124090 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 22:04:55.124090 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6a3577d-4aaf-4947-95c1-873076371ae7 could not be found. Jun 07 22:04:55.124090 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:04:55.125237 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-5ee2c8c6-0030-43bd-b21c-b7f4652db5b7 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Returning 404 to user: Instance b6a3577d-4aaf-4947-95c1-873076371ae7 could not be found. {{(pid=117970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 22:04:55.125237 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-5ee2c8c6-0030-43bd-b21c-b7f4652db5b7 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] 10.222.0.13 "DELETE /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7" status: 404 len: 111 microversion: 2.1 time: 0.037722 Jun 07 22:04:55.125237 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 151/322] 10.222.0.13 () {58 vars in 1238 bytes} [Tue Jun 7 22:04:55 2022] DELETE /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 07 22:04:55.125431 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-05a7af62-5ebd-477c-815e-7b393ef07b00 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:55.125431 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-05a7af62-5ebd-477c-815e-7b393ef07b00 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] [instance: 4d0577c2-268e-4615-a373-379b4979836d] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:55.128680 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-05a7af62-5ebd-477c-815e-7b393ef07b00 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:55.129125 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-05a7af62-5ebd-477c-815e-7b393ef07b00 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:55.129891 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-05a7af62-5ebd-477c-815e-7b393ef07b00 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:55.130324 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-05a7af62-5ebd-477c-815e-7b393ef07b00 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:55.130547 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-2083b7f6-cc17-4522-b8ac-8eab44e6dc32 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:55.131145 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-2083b7f6-cc17-4522-b8ac-8eab44e6dc32 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] [instance: b6a3577d-4aaf-4947-95c1-873076371ae7] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:55.138247 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-2083b7f6-cc17-4522-b8ac-8eab44e6dc32 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:55.138622 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-2083b7f6-cc17-4522-b8ac-8eab44e6dc32 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:55.139387 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-2083b7f6-cc17-4522-b8ac-8eab44e6dc32 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:55.139819 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-2083b7f6-cc17-4522-b8ac-8eab44e6dc32 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:55.149036 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_cell1:SELECT=100 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:04:55.153508 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.wsgi [None req-2083b7f6-cc17-4522-b8ac-8eab44e6dc32 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] HTTP exception thrown: Instance b6a3577d-4aaf-4947-95c1-873076371ae7 could not be found. Jun 07 22:04:55.155001 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-2083b7f6-cc17-4522-b8ac-8eab44e6dc32 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Request method failure captured: Jun 07 22:04:55.155001 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: request: GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7 HTTP/1.1 Jun 07 22:04:55.155001 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Accept: application/json Jun 07 22:04:55.155001 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Accept-Encoding: identity Jun 07 22:04:55.155001 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Connection: close Jun 07 22:04:55.155001 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Content-Length: 0 Jun 07 22:04:55.155001 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Content-Type: application/json Jun 07 22:04:55.155001 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Host: 10.222.0.13 Jun 07 22:04:55.155001 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Openstack-System-Scope: None Jun 07 22:04:55.155001 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: User-Agent: python-urllib3/1.26.9 Jun 07 22:04:55.155001 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Auth-Token: gAAAAABin8sZg2NwkZHg4ZYfrxb80B5D0hFxsk_cyJ8nHLGUBUD5sn3voiQeZrjA0rLNIgayLX6n9-7dabde4mQ7OMKuM__vmGJCD7sIzRhhppCUskglai-DjGb9Hhsm4a2WBMTuNIITmh5MkErP0L0SXOz4QXqUru4ErzyFc8v0yx7iPpNDnZs Jun 07 22:04:55.155001 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Domain-Id: None Jun 07 22:04:55.155001 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Domain-Name: None Jun 07 22:04:55.155001 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Identity-Status: Confirmed Jun 07 22:04:55.155001 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Is-Admin-Project: True Jun 07 22:04:55.155001 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Domain-Id: default Jun 07 22:04:55.155001 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Domain-Name: Default Jun 07 22:04:55.155001 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Id: 7e8d5b4fdf9a48a296359e167017123f Jun 07 22:04:55.155001 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Name: tempest-DeleteServersTestJSON-343950354 Jun 07 22:04:55.155001 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Role: member,reader Jun 07 22:04:55.155001 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Roles: member,reader Jun 07 22:04:55.156572 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7e8d5b4fdf9a48a296359e167017123f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7e8d5b4fdf9a48a296359e167017123f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7e8d5b4fdf9a48a296359e167017123f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7e8d5b4fdf9a48a296359e167017123f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}] Jun 07 22:04:55.156572 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Tenant: tempest-DeleteServersTestJSON-343950354 Jun 07 22:04:55.156572 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Tenant-Id: 7e8d5b4fdf9a48a296359e167017123f Jun 07 22:04:55.156572 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Tenant-Name: tempest-DeleteServersTestJSON-343950354 Jun 07 22:04:55.156572 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User: tempest-DeleteServersTestJSON-343950354-project Jun 07 22:04:55.156572 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Domain-Id: default Jun 07 22:04:55.156572 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Domain-Name: Default Jun 07 22:04:55.156572 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Id: 1378a898f9534635857e5958d32f00c5 Jun 07 22:04:55.156572 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Name: tempest-DeleteServersTestJSON-343950354-project Jun 07 22:04:55.156572 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: method: > Jun 07 22:04:55.156572 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: exception: Instance b6a3577d-4aaf-4947-95c1-873076371ae7 could not be found. Jun 07 22:04:55.156572 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: action_args: {'id': 'b6a3577d-4aaf-4947-95c1-873076371ae7'} Jun 07 22:04:55.157347 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 22:04:55.157347 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:04:55.157347 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 22:04:55.157347 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 22:04:55.157347 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 22:04:55.157347 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 22:04:55.157347 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 22:04:55.157347 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 22:04:55.157347 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 22:04:55.157347 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 22:04:55.157347 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6a3577d-4aaf-4947-95c1-873076371ae7 could not be found. Jun 07 22:04:55.157347 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:04:55.157347 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:04:55.157347 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:04:55.157347 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:04:55.157347 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:04:55.157347 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:04:55.157347 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 22:04:55.157347 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 22:04:55.157347 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 22:04:55.158688 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 22:04:55.158688 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 22:04:55.158688 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 22:04:55.158688 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 22:04:55.158688 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 22:04:55.158688 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 22:04:55.158688 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 22:04:55.158688 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6a3577d-4aaf-4947-95c1-873076371ae7 could not be found. Jun 07 22:04:55.158688 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:04:55.158688 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:04:55.158688 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:04:55.158688 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:04:55.158688 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:04:55.158688 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:04:55.158688 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 22:04:55.158688 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 22:04:55.158688 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6a3577d-4aaf-4947-95c1-873076371ae7 could not be found. Jun 07 22:04:55.158688 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:04:55.159918 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-2083b7f6-cc17-4522-b8ac-8eab44e6dc32 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] Returning 404 to user: Instance b6a3577d-4aaf-4947-95c1-873076371ae7 could not be found. {{(pid=117970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 22:04:55.159918 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-2083b7f6-cc17-4522-b8ac-8eab44e6dc32 tempest-DeleteServersTestJSON-343950354 tempest-DeleteServersTestJSON-343950354-project] 10.222.0.13 "GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7" status: 404 len: 111 microversion: 2.1 time: 0.029517 Jun 07 22:04:55.159918 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 152/323] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:55 2022] GET /compute/v2.1/servers/b6a3577d-4aaf-4947-95c1-873076371ae7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 22:04:55.325122 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-9133bcaf-da22-4687-ae3b-d54d278cc7e6 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:55.325838 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-9133bcaf-da22-4687-ae3b-d54d278cc7e6 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] [instance: 8f7f3be8-21d5-446e-9ee5-0caa7c97a68a] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:55.333850 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-9133bcaf-da22-4687-ae3b-d54d278cc7e6 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:55.334301 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-9133bcaf-da22-4687-ae3b-d54d278cc7e6 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:55.335073 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-9133bcaf-da22-4687-ae3b-d54d278cc7e6 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:55.335714 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-9133bcaf-da22-4687-ae3b-d54d278cc7e6 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:55.347991 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-05a7af62-5ebd-477c-815e-7b393ef07b00 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03864707f284a14ad9726c4023f32b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f240f9b198124b58826697af9f8ab205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:55.357909 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-05a7af62-5ebd-477c-815e-7b393ef07b00 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] 10.222.0.13 "GET /compute/v2.1/servers/4d0577c2-268e-4615-a373-379b4979836d" status: 200 len: 1315 microversion: 2.1 time: 0.240929 Jun 07 22:04:55.358633 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 172/324] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:55 2022] GET /compute/v2.1/servers/4d0577c2-268e-4615-a373-379b4979836d => generated 1315 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:55.498083 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-9133bcaf-da22-4687-ae3b-d54d278cc7e6 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4fc7744b3d4e5fb6e281fcc90cef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b84dd581fc4e9499cfecbb7242e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:55.505897 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-9133bcaf-da22-4687-ae3b-d54d278cc7e6 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] 10.222.0.13 "GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a" status: 200 len: 1318 microversion: 2.1 time: 0.184825 Jun 07 22:04:55.506692 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 153/325] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:55 2022] GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a => generated 1318 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:04:56.133003 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-94e67f0c-cf61-4334-a33e-19335ba232ba tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:56.133669 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-94e67f0c-cf61-4334-a33e-19335ba232ba tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:56.140119 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-94e67f0c-cf61-4334-a33e-19335ba232ba tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:56.140568 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-94e67f0c-cf61-4334-a33e-19335ba232ba tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:56.141317 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-94e67f0c-cf61-4334-a33e-19335ba232ba tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:56.141751 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-94e67f0c-cf61-4334-a33e-19335ba232ba tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:56.317297 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-94e67f0c-cf61-4334-a33e-19335ba232ba tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:56.325118 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-94e67f0c-cf61-4334-a33e-19335ba232ba tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1521 microversion: 2.1 time: 0.195977 Jun 07 22:04:56.325674 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 173/326] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:56 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:56.374514 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-d00a6a56-381d-45b6-90ea-7f7f13635d92 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:56.375117 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-d00a6a56-381d-45b6-90ea-7f7f13635d92 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] [instance: 4d0577c2-268e-4615-a373-379b4979836d] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:56.381082 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d00a6a56-381d-45b6-90ea-7f7f13635d92 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:56.381521 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d00a6a56-381d-45b6-90ea-7f7f13635d92 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:56.382279 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d00a6a56-381d-45b6-90ea-7f7f13635d92 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:56.382709 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d00a6a56-381d-45b6-90ea-7f7f13635d92 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:56.521839 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-d00a6a56-381d-45b6-90ea-7f7f13635d92 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03864707f284a14ad9726c4023f32b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f240f9b198124b58826697af9f8ab205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:56.522976 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-d6f4b7a7-e3ba-4a0d-8c35-4a48e97ab39c tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:56.523707 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-d6f4b7a7-e3ba-4a0d-8c35-4a48e97ab39c tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] [instance: 8f7f3be8-21d5-446e-9ee5-0caa7c97a68a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:56.530114 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-d6f4b7a7-e3ba-4a0d-8c35-4a48e97ab39c tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:56.530550 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-d6f4b7a7-e3ba-4a0d-8c35-4a48e97ab39c tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:56.531302 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-d6f4b7a7-e3ba-4a0d-8c35-4a48e97ab39c tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:56.531538 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-d00a6a56-381d-45b6-90ea-7f7f13635d92 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] 10.222.0.13 "GET /compute/v2.1/servers/4d0577c2-268e-4615-a373-379b4979836d" status: 200 len: 1315 microversion: 2.1 time: 0.160601 Jun 07 22:04:56.531757 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-d6f4b7a7-e3ba-4a0d-8c35-4a48e97ab39c tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:56.540716 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 154/327] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:56 2022] GET /compute/v2.1/servers/4d0577c2-268e-4615-a373-379b4979836d => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:56.698415 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-d6f4b7a7-e3ba-4a0d-8c35-4a48e97ab39c tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4fc7744b3d4e5fb6e281fcc90cef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b84dd581fc4e9499cfecbb7242e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:56.710399 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-d6f4b7a7-e3ba-4a0d-8c35-4a48e97ab39c tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] 10.222.0.13 "GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a" status: 200 len: 1318 microversion: 2.1 time: 0.190998 Jun 07 22:04:56.711278 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 174/328] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:56 2022] GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a => generated 1318 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:04:57.344118 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-434fb668-43b8-4c8e-bd57-0ca874faf4f1 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:57.344779 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-434fb668-43b8-4c8e-bd57-0ca874faf4f1 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:57.353371 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-434fb668-43b8-4c8e-bd57-0ca874faf4f1 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:57.353987 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-434fb668-43b8-4c8e-bd57-0ca874faf4f1 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:57.355416 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-434fb668-43b8-4c8e-bd57-0ca874faf4f1 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:57.356179 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-434fb668-43b8-4c8e-bd57-0ca874faf4f1 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:57.541500 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-434fb668-43b8-4c8e-bd57-0ca874faf4f1 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:57.550977 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-434fb668-43b8-4c8e-bd57-0ca874faf4f1 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1521 microversion: 2.1 time: 0.211623 Jun 07 22:04:57.551360 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-080ed38f-4170-4581-b498-c64abfa4c83c tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:57.551988 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 155/329] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:57 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:57.553023 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-080ed38f-4170-4581-b498-c64abfa4c83c tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] [instance: 4d0577c2-268e-4615-a373-379b4979836d] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:57.561894 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-080ed38f-4170-4581-b498-c64abfa4c83c tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:57.563463 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-080ed38f-4170-4581-b498-c64abfa4c83c tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:57.564511 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-080ed38f-4170-4581-b498-c64abfa4c83c tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:57.564955 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-080ed38f-4170-4581-b498-c64abfa4c83c tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:57.728163 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-c263e827-3066-4074-91d3-7f88a0c01c31 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:57.728794 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-c263e827-3066-4074-91d3-7f88a0c01c31 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] [instance: 8f7f3be8-21d5-446e-9ee5-0caa7c97a68a] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:57.735683 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c263e827-3066-4074-91d3-7f88a0c01c31 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:57.736357 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c263e827-3066-4074-91d3-7f88a0c01c31 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:57.737197 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c263e827-3066-4074-91d3-7f88a0c01c31 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:57.737629 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c263e827-3066-4074-91d3-7f88a0c01c31 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:57.743602 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-080ed38f-4170-4581-b498-c64abfa4c83c tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03864707f284a14ad9726c4023f32b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f240f9b198124b58826697af9f8ab205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:57.751435 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-080ed38f-4170-4581-b498-c64abfa4c83c tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] 10.222.0.13 "GET /compute/v2.1/servers/4d0577c2-268e-4615-a373-379b4979836d" status: 200 len: 1315 microversion: 2.1 time: 0.206582 Jun 07 22:04:57.752038 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 175/330] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:57 2022] GET /compute/v2.1/servers/4d0577c2-268e-4615-a373-379b4979836d => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:57.762205 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_cell1:SELECT=100 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:04:57.967717 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-c263e827-3066-4074-91d3-7f88a0c01c31 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4fc7744b3d4e5fb6e281fcc90cef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b84dd581fc4e9499cfecbb7242e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:57.975463 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-c263e827-3066-4074-91d3-7f88a0c01c31 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] 10.222.0.13 "GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a" status: 200 len: 1318 microversion: 2.1 time: 0.251708 Jun 07 22:04:57.976483 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 156/331] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:57 2022] GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a => generated 1318 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:04:58.570221 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-5364351d-5095-4b7a-adc1-9637eca032ea tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:58.570669 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-5364351d-5095-4b7a-adc1-9637eca032ea tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:58.578119 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-5364351d-5095-4b7a-adc1-9637eca032ea tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:58.578984 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-5364351d-5095-4b7a-adc1-9637eca032ea tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:58.580091 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-5364351d-5095-4b7a-adc1-9637eca032ea tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:58.580746 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-5364351d-5095-4b7a-adc1-9637eca032ea tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:58.770899 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-3fc40b1b-9248-45a8-b88f-8de9942a18cc tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:58.771626 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-3fc40b1b-9248-45a8-b88f-8de9942a18cc tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] [instance: 4d0577c2-268e-4615-a373-379b4979836d] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:58.784324 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-3fc40b1b-9248-45a8-b88f-8de9942a18cc tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:58.785231 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-3fc40b1b-9248-45a8-b88f-8de9942a18cc tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:58.786603 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-3fc40b1b-9248-45a8-b88f-8de9942a18cc tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:58.787190 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-3fc40b1b-9248-45a8-b88f-8de9942a18cc tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:58.841697 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-5364351d-5095-4b7a-adc1-9637eca032ea tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:58.864984 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-5364351d-5095-4b7a-adc1-9637eca032ea tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1521 microversion: 2.1 time: 0.298435 Jun 07 22:04:58.865707 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 176/332] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:58 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1521 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:58.996979 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-cc0dc6ec-ee1f-4bde-8382-19e97978e4a4 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:58.997583 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-cc0dc6ec-ee1f-4bde-8382-19e97978e4a4 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] [instance: 8f7f3be8-21d5-446e-9ee5-0caa7c97a68a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:59.003825 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-cc0dc6ec-ee1f-4bde-8382-19e97978e4a4 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:59.005120 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-cc0dc6ec-ee1f-4bde-8382-19e97978e4a4 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:59.006634 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-cc0dc6ec-ee1f-4bde-8382-19e97978e4a4 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:59.007275 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-cc0dc6ec-ee1f-4bde-8382-19e97978e4a4 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:59.136443 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-3fc40b1b-9248-45a8-b88f-8de9942a18cc tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03864707f284a14ad9726c4023f32b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f240f9b198124b58826697af9f8ab205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:59.149777 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-3fc40b1b-9248-45a8-b88f-8de9942a18cc tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] 10.222.0.13 "GET /compute/v2.1/servers/4d0577c2-268e-4615-a373-379b4979836d" status: 200 len: 1315 microversion: 2.1 time: 0.383033 Jun 07 22:04:59.158853 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 157/333] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:58 2022] GET /compute/v2.1/servers/4d0577c2-268e-4615-a373-379b4979836d => generated 1315 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:59.240548 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-cc0dc6ec-ee1f-4bde-8382-19e97978e4a4 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4fc7744b3d4e5fb6e281fcc90cef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b84dd581fc4e9499cfecbb7242e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:04:59.252172 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-cc0dc6ec-ee1f-4bde-8382-19e97978e4a4 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] 10.222.0.13 "GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a" status: 200 len: 1507 microversion: 2.1 time: 0.258977 Jun 07 22:04:59.252929 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 177/334] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:58 2022] GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a => generated 1507 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:04:59.882424 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-f8fca889-7459-445d-ab23-6ea9aa3c1f74 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:04:59.883813 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-f8fca889-7459-445d-ab23-6ea9aa3c1f74 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:04:59.905418 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f8fca889-7459-445d-ab23-6ea9aa3c1f74 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:59.906093 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f8fca889-7459-445d-ab23-6ea9aa3c1f74 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:04:59.907166 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f8fca889-7459-445d-ab23-6ea9aa3c1f74 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:04:59.908029 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f8fca889-7459-445d-ab23-6ea9aa3c1f74 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:00.166897 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-d5d56b57-9992-4002-8153-4e95ce8c0dfe tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:00.167599 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-d5d56b57-9992-4002-8153-4e95ce8c0dfe tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] [instance: 4d0577c2-268e-4615-a373-379b4979836d] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:00.176694 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-d5d56b57-9992-4002-8153-4e95ce8c0dfe tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:00.177294 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-d5d56b57-9992-4002-8153-4e95ce8c0dfe tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:00.178241 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-d5d56b57-9992-4002-8153-4e95ce8c0dfe tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:00.178903 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-d5d56b57-9992-4002-8153-4e95ce8c0dfe tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:00.367862 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-f8fca889-7459-445d-ab23-6ea9aa3c1f74 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:00.384145 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-f8fca889-7459-445d-ab23-6ea9aa3c1f74 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1521 microversion: 2.1 time: 0.505748 Jun 07 22:05:00.384925 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 158/335] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:04:59 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1521 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:05:00.425675 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-d5d56b57-9992-4002-8153-4e95ce8c0dfe tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03864707f284a14ad9726c4023f32b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f240f9b198124b58826697af9f8ab205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:00.438527 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-d5d56b57-9992-4002-8153-4e95ce8c0dfe tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] 10.222.0.13 "GET /compute/v2.1/servers/4d0577c2-268e-4615-a373-379b4979836d" status: 200 len: 1315 microversion: 2.1 time: 0.275261 Jun 07 22:05:00.439841 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 178/336] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:00 2022] GET /compute/v2.1/servers/4d0577c2-268e-4615-a373-379b4979836d => generated 1315 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:05:01.359993 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [req-d2f3ff57-1e0d-45ee-8f51-c46e99724b5a req-9e096321-aa04-434b-8f01-b776b5e1a645 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d0577c2-268e-4615-a373-379b4979836d", "name": "network-vif-plugged", "status": "completed", "tag": "6ba72632-5769-4f6c-aa4c-7db96324a52a"}]} {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:05:01.383870 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [req-d2f3ff57-1e0d-45ee-8f51-c46e99724b5a req-9e096321-aa04-434b-8f01-b776b5e1a645 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:01.384585 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [req-d2f3ff57-1e0d-45ee-8f51-c46e99724b5a req-9e096321-aa04-434b-8f01-b776b5e1a645 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:01.401479 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-f23f1c6f-2e67-40c3-b588-badfdfa07791 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:01.402019 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.compute.server_external_events [req-d2f3ff57-1e0d-45ee-8f51-c46e99724b5a req-9e096321-aa04-434b-8f01-b776b5e1a645 service nova] Creating event network-vif-plugged:6ba72632-5769-4f6c-aa4c-7db96324a52a for instance 4d0577c2-268e-4615-a373-379b4979836d on hv-cinder-83552 Jun 07 22:05:01.403473 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-f23f1c6f-2e67-40c3-b588-badfdfa07791 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:01.407582 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [req-d2f3ff57-1e0d-45ee-8f51-c46e99724b5a req-9e096321-aa04-434b-8f01-b776b5e1a645 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053590 Jun 07 22:05:01.409227 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 159/337] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:05:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:05:01.415163 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-f23f1c6f-2e67-40c3-b588-badfdfa07791 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:01.421489 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-f23f1c6f-2e67-40c3-b588-badfdfa07791 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:01.422307 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-f23f1c6f-2e67-40c3-b588-badfdfa07791 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:01.422747 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-f23f1c6f-2e67-40c3-b588-badfdfa07791 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:01.457774 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-1850a693-ec11-43f2-95a1-5085220dd361 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:01.458755 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-1850a693-ec11-43f2-95a1-5085220dd361 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] [instance: 4d0577c2-268e-4615-a373-379b4979836d] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:01.472904 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1850a693-ec11-43f2-95a1-5085220dd361 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:01.475522 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1850a693-ec11-43f2-95a1-5085220dd361 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:01.476907 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1850a693-ec11-43f2-95a1-5085220dd361 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:01.481815 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1850a693-ec11-43f2-95a1-5085220dd361 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:01.783133 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-1850a693-ec11-43f2-95a1-5085220dd361 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03864707f284a14ad9726c4023f32b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f240f9b198124b58826697af9f8ab205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:01.797464 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-1850a693-ec11-43f2-95a1-5085220dd361 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] 10.222.0.13 "GET /compute/v2.1/servers/4d0577c2-268e-4615-a373-379b4979836d" status: 200 len: 1315 microversion: 2.1 time: 0.345459 Jun 07 22:05:01.799557 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 160/338] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:01 2022] GET /compute/v2.1/servers/4d0577c2-268e-4615-a373-379b4979836d => generated 1315 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:05:01.829827 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-f23f1c6f-2e67-40c3-b588-badfdfa07791 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:01.842096 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-f23f1c6f-2e67-40c3-b588-badfdfa07791 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1521 microversion: 2.1 time: 0.442044 Jun 07 22:05:01.842930 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 179/339] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:01 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1521 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:05:02.819721 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-d3e8c9c6-5d7d-4749-a231-797f3ed87228 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:02.820339 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-d3e8c9c6-5d7d-4749-a231-797f3ed87228 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] [instance: 4d0577c2-268e-4615-a373-379b4979836d] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:02.827781 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d3e8c9c6-5d7d-4749-a231-797f3ed87228 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:02.828244 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d3e8c9c6-5d7d-4749-a231-797f3ed87228 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:02.829089 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d3e8c9c6-5d7d-4749-a231-797f3ed87228 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:02.829599 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d3e8c9c6-5d7d-4749-a231-797f3ed87228 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:02.859489 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-59206542-4c54-4419-9e66-bc5ea23c8e5b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:02.860207 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-59206542-4c54-4419-9e66-bc5ea23c8e5b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:02.870336 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-59206542-4c54-4419-9e66-bc5ea23c8e5b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:02.872507 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-59206542-4c54-4419-9e66-bc5ea23c8e5b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:02.880160 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-59206542-4c54-4419-9e66-bc5ea23c8e5b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:02.880694 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-59206542-4c54-4419-9e66-bc5ea23c8e5b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:03.077914 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-d3e8c9c6-5d7d-4749-a231-797f3ed87228 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03864707f284a14ad9726c4023f32b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f240f9b198124b58826697af9f8ab205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:03.085777 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-d3e8c9c6-5d7d-4749-a231-797f3ed87228 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] 10.222.0.13 "GET /compute/v2.1/servers/4d0577c2-268e-4615-a373-379b4979836d" status: 200 len: 1315 microversion: 2.1 time: 0.273962 Jun 07 22:05:03.099050 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 161/340] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:02 2022] GET /compute/v2.1/servers/4d0577c2-268e-4615-a373-379b4979836d => generated 1315 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:05:03.240268 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-59206542-4c54-4419-9e66-bc5ea23c8e5b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:03.255274 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-59206542-4c54-4419-9e66-bc5ea23c8e5b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1521 microversion: 2.1 time: 0.395644 Jun 07 22:05:03.256603 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 180/341] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:02 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1521 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:05:04.106111 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-4f476d45-a5d7-461e-8200-0ce65e75b385 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:04.106708 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-4f476d45-a5d7-461e-8200-0ce65e75b385 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] [instance: 4d0577c2-268e-4615-a373-379b4979836d] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:04.115365 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-4f476d45-a5d7-461e-8200-0ce65e75b385 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:04.115970 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-4f476d45-a5d7-461e-8200-0ce65e75b385 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:04.117009 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-4f476d45-a5d7-461e-8200-0ce65e75b385 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:04.118126 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-4f476d45-a5d7-461e-8200-0ce65e75b385 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:04.169410 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-52c8a9d1-2c87-4129-8c85-089d6c35efcb tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Action: 'create', calling method: .version_select at 0x7f92f172e1f0>, body: {"keypair": {"name": "tempest-keypair-1041837428", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+Qdp+cucdraNEAbo6Nd4NA2FGxdsYsopv0dOikQ4svzMBuu/9De3401Z/nIJ3Kn1kI4yKTJQGZ8mRYpfu5U2UY5YiqcD3b/ZSLIVpsPhk3TSXS8IOy0PMawMjd/i57Ow=="}} {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:05:04.185431 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.quota [None req-52c8a9d1-2c87-4129-8c85-089d6c35efcb tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Getting quotas for project 9f0ee4be50354a20baf5af85aeb4c3b2. Resources: {'key_pairs'} {{(pid=117970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 22:05:04.189881 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.quota [None req-52c8a9d1-2c87-4129-8c85-089d6c35efcb tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Getting quotas for user de021dc74a4446d8b6a63883fd56a7c4 and project 9f0ee4be50354a20baf5af85aeb4c3b2. Resources: {'key_pairs'} {{(pid=117970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 22:05:04.218276 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-52c8a9d1-2c87-4129-8c85-089d6c35efcb tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.233641 Jun 07 22:05:04.220891 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 162/342] 10.222.0.13 () {62 vars in 1199 bytes} [Tue Jun 7 22:05:03 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 238 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 07 22:05:04.273370 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-8ba57d63-1e29-420e-ae9d-531e5241da78 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:04.274667 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-8ba57d63-1e29-420e-ae9d-531e5241da78 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:04.285041 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-8ba57d63-1e29-420e-ae9d-531e5241da78 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:04.285497 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-8ba57d63-1e29-420e-ae9d-531e5241da78 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:04.288070 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-8ba57d63-1e29-420e-ae9d-531e5241da78 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:04.288539 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-8ba57d63-1e29-420e-ae9d-531e5241da78 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:04.290749 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-4f476d45-a5d7-461e-8200-0ce65e75b385 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03864707f284a14ad9726c4023f32b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f240f9b198124b58826697af9f8ab205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:04.305556 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-4f476d45-a5d7-461e-8200-0ce65e75b385 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] 10.222.0.13 "GET /compute/v2.1/servers/4d0577c2-268e-4615-a373-379b4979836d" status: 200 len: 1464 microversion: 2.1 time: 0.203185 Jun 07 22:05:04.306786 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 181/343] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:04 2022] GET /compute/v2.1/servers/4d0577c2-268e-4615-a373-379b4979836d => generated 1464 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:05:04.370868 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-68af2edb-f4f6-4462-b282-39f8fd5cbebc tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:04.371527 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-68af2edb-f4f6-4462-b282-39f8fd5cbebc tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] [instance: 4d0577c2-268e-4615-a373-379b4979836d] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:04.377678 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-68af2edb-f4f6-4462-b282-39f8fd5cbebc tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:04.378212 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-68af2edb-f4f6-4462-b282-39f8fd5cbebc tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:04.379123 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-68af2edb-f4f6-4462-b282-39f8fd5cbebc tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:04.379631 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-68af2edb-f4f6-4462-b282-39f8fd5cbebc tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:04.412479 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-68af2edb-f4f6-4462-b282-39f8fd5cbebc tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] [instance: 4d0577c2-268e-4615-a373-379b4979836d] Going to try to terminate instance {{(pid=117971) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 22:05:04.510195 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-8ba57d63-1e29-420e-ae9d-531e5241da78 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:04.522498 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-8ba57d63-1e29-420e-ae9d-531e5241da78 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1521 microversion: 2.1 time: 0.254021 Jun 07 22:05:04.524447 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 163/344] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:04 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1521 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:05:04.567738 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-68af2edb-f4f6-4462-b282-39f8fd5cbebc tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] 10.222.0.13 "DELETE /compute/v2.1/servers/4d0577c2-268e-4615-a373-379b4979836d" status: 204 len: 0 microversion: 2.1 time: 0.196335 Jun 07 22:05:04.568448 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 182/345] 10.222.0.13 () {58 vars in 1238 bytes} [Tue Jun 7 22:05:04 2022] DELETE /compute/v2.1/servers/4d0577c2-268e-4615-a373-379b4979836d => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 07 22:05:04.579722 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-5c9838b4-9bd6-47a4-b0b6-5ca53f194710 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:04.581094 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-5c9838b4-9bd6-47a4-b0b6-5ca53f194710 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] [instance: 4d0577c2-268e-4615-a373-379b4979836d] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:04.600719 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-5c9838b4-9bd6-47a4-b0b6-5ca53f194710 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:04.601427 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-5c9838b4-9bd6-47a4-b0b6-5ca53f194710 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:04.602338 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-5c9838b4-9bd6-47a4-b0b6-5ca53f194710 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:04.602864 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-5c9838b4-9bd6-47a4-b0b6-5ca53f194710 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:04.786785 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-5c9838b4-9bd6-47a4-b0b6-5ca53f194710 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03864707f284a14ad9726c4023f32b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f240f9b198124b58826697af9f8ab205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:04.796398 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-5c9838b4-9bd6-47a4-b0b6-5ca53f194710 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] 10.222.0.13 "GET /compute/v2.1/servers/4d0577c2-268e-4615-a373-379b4979836d" status: 200 len: 1470 microversion: 2.1 time: 0.221531 Jun 07 22:05:04.807885 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 164/346] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:04 2022] GET /compute/v2.1/servers/4d0577c2-268e-4615-a373-379b4979836d => generated 1470 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:05:05.541724 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-9fe68150-eb12-47b6-9833-4fb36e1b2dd9 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:05.542515 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-9fe68150-eb12-47b6-9833-4fb36e1b2dd9 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:05.550387 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-9fe68150-eb12-47b6-9833-4fb36e1b2dd9 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:05.550977 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-9fe68150-eb12-47b6-9833-4fb36e1b2dd9 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:05.552150 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-9fe68150-eb12-47b6-9833-4fb36e1b2dd9 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:05.552803 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-9fe68150-eb12-47b6-9833-4fb36e1b2dd9 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:05.761761 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-9fe68150-eb12-47b6-9833-4fb36e1b2dd9 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:05.776154 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-9fe68150-eb12-47b6-9833-4fb36e1b2dd9 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1521 microversion: 2.1 time: 0.238219 Jun 07 22:05:05.777539 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 183/347] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:05 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1521 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:05:05.823550 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-37422502-b58a-4697-b623-0190fd3a81c9 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:05.824915 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-37422502-b58a-4697-b623-0190fd3a81c9 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] [instance: 4d0577c2-268e-4615-a373-379b4979836d] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:05.831681 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-37422502-b58a-4697-b623-0190fd3a81c9 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:05.832440 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-37422502-b58a-4697-b623-0190fd3a81c9 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:05.833305 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-37422502-b58a-4697-b623-0190fd3a81c9 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:05.833811 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-37422502-b58a-4697-b623-0190fd3a81c9 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:05.962845 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-32ca82c9-f496-4236-b793-cc8ec5ea6e89 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1353672518", "imageRef": "87e2e140-6de8-4531-9681-d0a3e069622d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "aa5412b6-0e66-4970-af26-c42e829698c4"}], "security_groups": [{"name": "tempest-securitygroup--1750151835"}], "key_name": "tempest-keypair-1041837428", "user_data": "}} {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:05:06.022289 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-37422502-b58a-4697-b623-0190fd3a81c9 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03864707f284a14ad9726c4023f32b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f240f9b198124b58826697af9f8ab205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:06.031852 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-37422502-b58a-4697-b623-0190fd3a81c9 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] 10.222.0.13 "GET /compute/v2.1/servers/4d0577c2-268e-4615-a373-379b4979836d" status: 200 len: 1470 microversion: 2.1 time: 0.219091 Jun 07 22:05:06.032438 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 165/348] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:05 2022] GET /compute/v2.1/servers/4d0577c2-268e-4615-a373-379b4979836d => generated 1470 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:05:06.112032 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.network.neutron [None req-32ca82c9-f496-4236-b793-cc8ec5ea6e89 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] validate_networks() for [('aa5412b6-0e66-4970-af26-c42e829698c4', None, None, None, None, None)] {{(pid=117971) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 22:05:06.522327 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.virt.hardware [None req-32ca82c9-f496-4236-b793-cc8ec5ea6e89 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Flavor limits 0:0:0 {{(pid=117971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 22:05:06.522927 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.virt.hardware [None req-32ca82c9-f496-4236-b793-cc8ec5ea6e89 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Image limits 0:0:0 {{(pid=117971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 22:05:06.523450 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.virt.hardware [None req-32ca82c9-f496-4236-b793-cc8ec5ea6e89 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Flavor pref 0:0:0 {{(pid=117971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 22:05:06.525149 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.virt.hardware [None req-32ca82c9-f496-4236-b793-cc8ec5ea6e89 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Image pref 0:0:0 {{(pid=117971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 22:05:06.525560 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.virt.hardware [None req-32ca82c9-f496-4236-b793-cc8ec5ea6e89 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 22:05:06.534526 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-32ca82c9-f496-4236-b793-cc8ec5ea6e89 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:06.534962 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-32ca82c9-f496-4236-b793-cc8ec5ea6e89 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:06.535784 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-32ca82c9-f496-4236-b793-cc8ec5ea6e89 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:06.536212 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-32ca82c9-f496-4236-b793-cc8ec5ea6e89 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:06.553424 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.quota [None req-32ca82c9-f496-4236-b793-cc8ec5ea6e89 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Getting quotas for project 9f0ee4be50354a20baf5af85aeb4c3b2. Resources: {'cores', 'ram', 'instances'} {{(pid=117971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 22:05:06.558802 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.quota [None req-32ca82c9-f496-4236-b793-cc8ec5ea6e89 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Getting quotas for user de021dc74a4446d8b6a63883fd56a7c4 and project 9f0ee4be50354a20baf5af85aeb4c3b2. Resources: {'cores', 'ram', 'instances'} {{(pid=117971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 22:05:06.569980 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-32ca82c9-f496-4236-b793-cc8ec5ea6e89 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Going to run 1 instances... {{(pid=117971) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 22:05:06.573068 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-32ca82c9-f496-4236-b793-cc8ec5ea6e89 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='87e2e140-6de8-4531-9681-d0a3e069622d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 22:05:06.623129 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-32ca82c9-f496-4236-b793-cc8ec5ea6e89 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.665896 Jun 07 22:05:06.624322 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 184/349] 10.222.0.13 () {62 vars in 1187 bytes} [Tue Jun 7 22:05:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 668 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jun 07 22:05:06.635100 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-2a8c1157-a433-4834-840f-117fb98f70b7 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:06.636096 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-2a8c1157-a433-4834-840f-117fb98f70b7 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:06.702489 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-2a8c1157-a433-4834-840f-117fb98f70b7 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:06.710158 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-2a8c1157-a433-4834-840f-117fb98f70b7 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:06.712866 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-2a8c1157-a433-4834-840f-117fb98f70b7 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:06.714163 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-2a8c1157-a433-4834-840f-117fb98f70b7 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1282 microversion: 2.20 time: 0.083585 Jun 07 22:05:06.715082 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 166/350] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:05:06 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1282 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:05:06.795133 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-5360eb38-f307-4786-8db3-afa8025a8eee tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:06.795810 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-5360eb38-f307-4786-8db3-afa8025a8eee tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:06.806006 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-5360eb38-f307-4786-8db3-afa8025a8eee tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:06.806464 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-5360eb38-f307-4786-8db3-afa8025a8eee tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:06.807308 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-5360eb38-f307-4786-8db3-afa8025a8eee tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:06.815983 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-5360eb38-f307-4786-8db3-afa8025a8eee tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:06.924206 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-18df3e67-42f9-432d-b3e1-29f7370863b6 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1080662665", "imageRef": "87e2e140-6de8-4531-9681-d0a3e069622d", "flavorRef": "452", "networks": [{"uuid": "5daa3807-4fcf-4a6c-9cd4-3f71c49f352b"}]}} {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:05:07.062107 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.network.neutron [None req-18df3e67-42f9-432d-b3e1-29f7370863b6 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] validate_networks() for [('5daa3807-4fcf-4a6c-9cd4-3f71c49f352b', None, None, None, None, None)] {{(pid=117970) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 22:05:07.073305 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-5360eb38-f307-4786-8db3-afa8025a8eee tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:07.085770 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-5360eb38-f307-4786-8db3-afa8025a8eee tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1521 microversion: 2.1 time: 0.292700 Jun 07 22:05:07.087798 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 185/351] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:06 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1521 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:05:07.093437 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-80e42668-9805-4865-9cab-77605ef68cf2 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:07.094340 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-80e42668-9805-4865-9cab-77605ef68cf2 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] [instance: 4d0577c2-268e-4615-a373-379b4979836d] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:07.102605 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-80e42668-9805-4865-9cab-77605ef68cf2 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:07.103313 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-80e42668-9805-4865-9cab-77605ef68cf2 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:07.104247 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-80e42668-9805-4865-9cab-77605ef68cf2 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:07.104818 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-80e42668-9805-4865-9cab-77605ef68cf2 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:07.279755 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-80e42668-9805-4865-9cab-77605ef68cf2 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03864707f284a14ad9726c4023f32b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f240f9b198124b58826697af9f8ab205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:07.292515 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-80e42668-9805-4865-9cab-77605ef68cf2 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] 10.222.0.13 "GET /compute/v2.1/servers/4d0577c2-268e-4615-a373-379b4979836d" status: 200 len: 1470 microversion: 2.1 time: 0.203315 Jun 07 22:05:07.293731 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 186/352] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:07 2022] GET /compute/v2.1/servers/4d0577c2-268e-4615-a373-379b4979836d => generated 1470 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:05:07.734035 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-2bbe4bb7-0cd2-448b-a7b5-a57451bd29f0 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:07.735582 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-2bbe4bb7-0cd2-448b-a7b5-a57451bd29f0 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:07.742799 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-2bbe4bb7-0cd2-448b-a7b5-a57451bd29f0 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:07.743699 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-2bbe4bb7-0cd2-448b-a7b5-a57451bd29f0 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:07.744797 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-2bbe4bb7-0cd2-448b-a7b5-a57451bd29f0 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:07.745503 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-2bbe4bb7-0cd2-448b-a7b5-a57451bd29f0 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:07.810810 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.virt.hardware [None req-18df3e67-42f9-432d-b3e1-29f7370863b6 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Flavor limits 0:0:0 {{(pid=117970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 22:05:07.811155 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.virt.hardware [None req-18df3e67-42f9-432d-b3e1-29f7370863b6 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Image limits 0:0:0 {{(pid=117970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 22:05:07.811908 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.virt.hardware [None req-18df3e67-42f9-432d-b3e1-29f7370863b6 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Flavor pref 0:0:0 {{(pid=117970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 22:05:07.812762 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.virt.hardware [None req-18df3e67-42f9-432d-b3e1-29f7370863b6 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Image pref 0:0:0 {{(pid=117970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 22:05:07.813838 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.virt.hardware [None req-18df3e67-42f9-432d-b3e1-29f7370863b6 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 22:05:07.827056 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-18df3e67-42f9-432d-b3e1-29f7370863b6 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:07.827734 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-18df3e67-42f9-432d-b3e1-29f7370863b6 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:07.828735 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-18df3e67-42f9-432d-b3e1-29f7370863b6 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:07.829391 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-18df3e67-42f9-432d-b3e1-29f7370863b6 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:07.852101 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-2bbe4bb7-0cd2-448b-a7b5-a57451bd29f0 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:07.858445 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.quota [None req-18df3e67-42f9-432d-b3e1-29f7370863b6 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Getting quotas for project bc558dd3848d4d3d950d7cd408e19741. Resources: {'cores', 'ram', 'instances'} {{(pid=117970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 22:05:07.865952 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.quota [None req-18df3e67-42f9-432d-b3e1-29f7370863b6 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Getting quotas for user 7ce9ec4aea9449d3890f6dbb93f97968 and project bc558dd3848d4d3d950d7cd408e19741. Resources: {'cores', 'ram', 'instances'} {{(pid=117970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 22:05:07.874038 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-2bbe4bb7-0cd2-448b-a7b5-a57451bd29f0 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:07.880918 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-2bbe4bb7-0cd2-448b-a7b5-a57451bd29f0 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:07.882537 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-2bbe4bb7-0cd2-448b-a7b5-a57451bd29f0 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1334 microversion: 2.20 time: 0.152807 Jun 07 22:05:07.894851 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 187/353] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:05:07 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1334 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:05:07.905108 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-18df3e67-42f9-432d-b3e1-29f7370863b6 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Going to run 1 instances... {{(pid=117970) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 22:05:07.907523 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-18df3e67-42f9-432d-b3e1-29f7370863b6 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 12d312ce-b6a9-4f85-990c-772d64ee228f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='87e2e140-6de8-4531-9681-d0a3e069622d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 22:05:07.984570 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-18df3e67-42f9-432d-b3e1-29f7370863b6 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.057590 Jun 07 22:05:07.985278 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 167/354] 10.222.0.13 () {60 vars in 1146 bytes} [Tue Jun 7 22:05:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1066 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 07 22:05:08.001389 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-e4b38c2d-c7d7-476e-9a37-778d17e0e90e tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:08.008798 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-e4b38c2d-c7d7-476e-9a37-778d17e0e90e tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 12d312ce-b6a9-4f85-990c-772d64ee228f] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:08.060940 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [req-be94bb22-7dd2-42c6-8dc8-584cc834e132 req-44cade14-c590-4eb2-8f14-0479ed68295e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d0577c2-268e-4615-a373-379b4979836d", "name": "network-vif-deleted", "tag": "6ba72632-5769-4f6c-aa4c-7db96324a52a"}]} {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:05:08.069716 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [req-be94bb22-7dd2-42c6-8dc8-584cc834e132 req-44cade14-c590-4eb2-8f14-0479ed68295e service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:08.070164 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [req-be94bb22-7dd2-42c6-8dc8-584cc834e132 req-44cade14-c590-4eb2-8f14-0479ed68295e service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:08.082984 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.compute.server_external_events [req-be94bb22-7dd2-42c6-8dc8-584cc834e132 req-44cade14-c590-4eb2-8f14-0479ed68295e service nova] Creating event network-vif-deleted:6ba72632-5769-4f6c-aa4c-7db96324a52a for instance 4d0577c2-268e-4615-a373-379b4979836d on hv-cinder-83552 Jun 07 22:05:08.089154 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [req-be94bb22-7dd2-42c6-8dc8-584cc834e132 req-44cade14-c590-4eb2-8f14-0479ed68295e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031885 Jun 07 22:05:08.093809 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 168/355] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:05:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:05:08.111278 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-c7d9f82b-98d3-45c7-a87f-6edde6ee39bf tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:08.112771 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-c7d9f82b-98d3-45c7-a87f-6edde6ee39bf tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:08.120115 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c7d9f82b-98d3-45c7-a87f-6edde6ee39bf tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:08.120875 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c7d9f82b-98d3-45c7-a87f-6edde6ee39bf tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:08.121646 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c7d9f82b-98d3-45c7-a87f-6edde6ee39bf tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:08.122079 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c7d9f82b-98d3-45c7-a87f-6edde6ee39bf tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:08.137299 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-e4b38c2d-c7d7-476e-9a37-778d17e0e90e tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce9ec4aea9449d3890f6dbb93f97968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc558dd3848d4d3d950d7cd408e19741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:08.144302 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-e4b38c2d-c7d7-476e-9a37-778d17e0e90e tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "GET /compute/v2.1/servers/12d312ce-b6a9-4f85-990c-772d64ee228f" status: 200 len: 1214 microversion: 2.1 time: 0.152914 Jun 07 22:05:08.146672 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 188/356] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:07 2022] GET /compute/v2.1/servers/12d312ce-b6a9-4f85-990c-772d64ee228f => generated 1214 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:05:08.310923 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-4a1f53d2-fd86-4cd2-8867-d008907cb850 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:08.311578 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-4a1f53d2-fd86-4cd2-8867-d008907cb850 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] [instance: 4d0577c2-268e-4615-a373-379b4979836d] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:08.319085 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-4a1f53d2-fd86-4cd2-8867-d008907cb850 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:08.320016 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-4a1f53d2-fd86-4cd2-8867-d008907cb850 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:08.321828 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-4a1f53d2-fd86-4cd2-8867-d008907cb850 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:08.322335 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-4a1f53d2-fd86-4cd2-8867-d008907cb850 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:08.348502 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:05:08.357199 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-c7d9f82b-98d3-45c7-a87f-6edde6ee39bf tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:08.375988 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-c7d9f82b-98d3-45c7-a87f-6edde6ee39bf tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1521 microversion: 2.1 time: 0.269132 Jun 07 22:05:08.379515 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 169/357] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:08 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1521 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:05:08.421072 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-4a1f53d2-fd86-4cd2-8867-d008907cb850 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03864707f284a14ad9726c4023f32b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f240f9b198124b58826697af9f8ab205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:08.431554 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-4a1f53d2-fd86-4cd2-8867-d008907cb850 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] 10.222.0.13 "GET /compute/v2.1/servers/4d0577c2-268e-4615-a373-379b4979836d" status: 200 len: 1300 microversion: 2.1 time: 0.125137 Jun 07 22:05:08.432849 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 189/358] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:08 2022] GET /compute/v2.1/servers/4d0577c2-268e-4615-a373-379b4979836d => generated 1300 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:05:08.904183 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-2973095e-129c-49f1-b606-d63630948124 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:08.905271 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-2973095e-129c-49f1-b606-d63630948124 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:08.911719 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-2973095e-129c-49f1-b606-d63630948124 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:08.912352 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-2973095e-129c-49f1-b606-d63630948124 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:08.913938 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-2973095e-129c-49f1-b606-d63630948124 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:08.915569 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-2973095e-129c-49f1-b606-d63630948124 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:08.996331 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-2973095e-129c-49f1-b606-d63630948124 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:09.004764 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-2973095e-129c-49f1-b606-d63630948124 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:09.006261 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-2973095e-129c-49f1-b606-d63630948124 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:09.007387 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-2973095e-129c-49f1-b606-d63630948124 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1352 microversion: 2.20 time: 0.109607 Jun 07 22:05:09.008946 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 170/359] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:05:08 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1352 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:05:09.162340 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-96cadf93-27f2-4edc-808b-78070f982f13 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:09.162944 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-96cadf93-27f2-4edc-808b-78070f982f13 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 12d312ce-b6a9-4f85-990c-772d64ee228f] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:09.169759 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-96cadf93-27f2-4edc-808b-78070f982f13 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:09.170207 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-96cadf93-27f2-4edc-808b-78070f982f13 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:09.170962 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-96cadf93-27f2-4edc-808b-78070f982f13 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:09.171431 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-96cadf93-27f2-4edc-808b-78070f982f13 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:09.233735 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-96cadf93-27f2-4edc-808b-78070f982f13 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce9ec4aea9449d3890f6dbb93f97968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc558dd3848d4d3d950d7cd408e19741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:09.241047 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-96cadf93-27f2-4edc-808b-78070f982f13 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "GET /compute/v2.1/servers/12d312ce-b6a9-4f85-990c-772d64ee228f" status: 200 len: 1210 microversion: 2.1 time: 0.082605 Jun 07 22:05:09.241607 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 190/360] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:09 2022] GET /compute/v2.1/servers/12d312ce-b6a9-4f85-990c-772d64ee228f => generated 1210 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:05:09.400096 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-fc2d0b9f-1727-43cf-8a8f-87895796b84e tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:09.401068 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-fc2d0b9f-1727-43cf-8a8f-87895796b84e tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:09.409427 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-fc2d0b9f-1727-43cf-8a8f-87895796b84e tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:09.410365 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-fc2d0b9f-1727-43cf-8a8f-87895796b84e tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:09.411512 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-fc2d0b9f-1727-43cf-8a8f-87895796b84e tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:09.412024 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-fc2d0b9f-1727-43cf-8a8f-87895796b84e tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:09.450069 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-5d7c6111-c409-44d9-b80b-6cd9ede3ec31 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:09.450802 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-5d7c6111-c409-44d9-b80b-6cd9ede3ec31 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] [instance: 4d0577c2-268e-4615-a373-379b4979836d] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:09.456831 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-5d7c6111-c409-44d9-b80b-6cd9ede3ec31 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:09.457353 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-5d7c6111-c409-44d9-b80b-6cd9ede3ec31 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:09.458177 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-5d7c6111-c409-44d9-b80b-6cd9ede3ec31 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:09.458679 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-5d7c6111-c409-44d9-b80b-6cd9ede3ec31 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:09.491302 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-5d7c6111-c409-44d9-b80b-6cd9ede3ec31 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:09.491925 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-5d7c6111-c409-44d9-b80b-6cd9ede3ec31 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:09.492504 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.objects.instance [None req-5d7c6111-c409-44d9-b80b-6cd9ede3ec31 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lazy-loading 'fault' on Instance uuid 4d0577c2-268e-4615-a373-379b4979836d {{(pid=117971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 22:05:09.550403 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-5d7c6111-c409-44d9-b80b-6cd9ede3ec31 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03864707f284a14ad9726c4023f32b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f240f9b198124b58826697af9f8ab205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:09.558129 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-5d7c6111-c409-44d9-b80b-6cd9ede3ec31 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] 10.222.0.13 "GET /compute/v2.1/servers/4d0577c2-268e-4615-a373-379b4979836d" status: 200 len: 1305 microversion: 2.1 time: 0.112296 Jun 07 22:05:09.558698 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 191/361] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:09 2022] GET /compute/v2.1/servers/4d0577c2-268e-4615-a373-379b4979836d => generated 1305 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:05:09.609230 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-fc2d0b9f-1727-43cf-8a8f-87895796b84e tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:09.616624 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-fc2d0b9f-1727-43cf-8a8f-87895796b84e tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1521 microversion: 2.1 time: 0.222518 Jun 07 22:05:09.617213 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 171/362] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:09 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:05:10.027491 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-c8c3bc55-480d-432b-9b29-0c4476dd5776 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:10.028430 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-c8c3bc55-480d-432b-9b29-0c4476dd5776 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:10.035466 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c8c3bc55-480d-432b-9b29-0c4476dd5776 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:10.035973 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c8c3bc55-480d-432b-9b29-0c4476dd5776 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:10.036885 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c8c3bc55-480d-432b-9b29-0c4476dd5776 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:10.037324 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c8c3bc55-480d-432b-9b29-0c4476dd5776 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:10.172478 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-c8c3bc55-480d-432b-9b29-0c4476dd5776 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:10.181820 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-c8c3bc55-480d-432b-9b29-0c4476dd5776 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:10.183683 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-c8c3bc55-480d-432b-9b29-0c4476dd5776 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:10.185003 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-c8c3bc55-480d-432b-9b29-0c4476dd5776 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1408 microversion: 2.20 time: 0.162935 Jun 07 22:05:10.185609 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 192/363] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:05:10 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1408 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:05:10.258688 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-61c376d2-742a-4695-bc64-eba365fdd654 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:10.259562 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-61c376d2-742a-4695-bc64-eba365fdd654 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 12d312ce-b6a9-4f85-990c-772d64ee228f] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:10.265575 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-61c376d2-742a-4695-bc64-eba365fdd654 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:10.266014 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-61c376d2-742a-4695-bc64-eba365fdd654 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:10.266778 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-61c376d2-742a-4695-bc64-eba365fdd654 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:10.267208 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-61c376d2-742a-4695-bc64-eba365fdd654 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:10.331532 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-61c376d2-742a-4695-bc64-eba365fdd654 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce9ec4aea9449d3890f6dbb93f97968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc558dd3848d4d3d950d7cd408e19741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:10.339702 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-61c376d2-742a-4695-bc64-eba365fdd654 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "GET /compute/v2.1/servers/12d312ce-b6a9-4f85-990c-772d64ee228f" status: 200 len: 1266 microversion: 2.1 time: 0.085573 Jun 07 22:05:10.340262 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 172/364] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:10 2022] GET /compute/v2.1/servers/12d312ce-b6a9-4f85-990c-772d64ee228f => generated 1266 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:05:10.578569 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-6bfd4f5a-2371-4c5e-ab42-5245a24dea55 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:10.579180 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-6bfd4f5a-2371-4c5e-ab42-5245a24dea55 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] [instance: 4d0577c2-268e-4615-a373-379b4979836d] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:10.585304 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-6bfd4f5a-2371-4c5e-ab42-5245a24dea55 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:10.585753 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-6bfd4f5a-2371-4c5e-ab42-5245a24dea55 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:10.587277 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-6bfd4f5a-2371-4c5e-ab42-5245a24dea55 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:10.587745 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-6bfd4f5a-2371-4c5e-ab42-5245a24dea55 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:10.619752 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-6bfd4f5a-2371-4c5e-ab42-5245a24dea55 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:10.620197 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-6bfd4f5a-2371-4c5e-ab42-5245a24dea55 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:10.620644 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.objects.instance [None req-6bfd4f5a-2371-4c5e-ab42-5245a24dea55 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lazy-loading 'fault' on Instance uuid 4d0577c2-268e-4615-a373-379b4979836d {{(pid=117971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 22:05:10.633835 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-6eba577a-98a2-4394-b0ed-9e3f87c863bb tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:10.634437 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-6eba577a-98a2-4394-b0ed-9e3f87c863bb tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:10.640553 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6eba577a-98a2-4394-b0ed-9e3f87c863bb tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:10.640993 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6eba577a-98a2-4394-b0ed-9e3f87c863bb tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:10.641746 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6eba577a-98a2-4394-b0ed-9e3f87c863bb tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:10.642177 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6eba577a-98a2-4394-b0ed-9e3f87c863bb tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:10.664704 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-6bfd4f5a-2371-4c5e-ab42-5245a24dea55 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03864707f284a14ad9726c4023f32b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f240f9b198124b58826697af9f8ab205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:10.675363 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-6bfd4f5a-2371-4c5e-ab42-5245a24dea55 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] 10.222.0.13 "GET /compute/v2.1/servers/4d0577c2-268e-4615-a373-379b4979836d" status: 200 len: 1305 microversion: 2.1 time: 0.099330 Jun 07 22:05:10.675363 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 193/365] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:10 2022] GET /compute/v2.1/servers/4d0577c2-268e-4615-a373-379b4979836d => generated 1305 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:05:10.773690 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-6eba577a-98a2-4394-b0ed-9e3f87c863bb tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:10.781152 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-6eba577a-98a2-4394-b0ed-9e3f87c863bb tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1521 microversion: 2.1 time: 0.151687 Jun 07 22:05:10.781710 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 173/366] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:10 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:05:11.203189 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-c6f8ae0c-a948-4f10-a492-cedb39d6b626 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:11.203822 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-c6f8ae0c-a948-4f10-a492-cedb39d6b626 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:11.210806 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c6f8ae0c-a948-4f10-a492-cedb39d6b626 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:11.211421 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c6f8ae0c-a948-4f10-a492-cedb39d6b626 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:11.212270 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c6f8ae0c-a948-4f10-a492-cedb39d6b626 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:11.212727 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c6f8ae0c-a948-4f10-a492-cedb39d6b626 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:11.340394 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-c6f8ae0c-a948-4f10-a492-cedb39d6b626 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:11.348510 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-c6f8ae0c-a948-4f10-a492-cedb39d6b626 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:11.350132 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-c6f8ae0c-a948-4f10-a492-cedb39d6b626 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:11.352301 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-c6f8ae0c-a948-4f10-a492-cedb39d6b626 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1408 microversion: 2.20 time: 0.152354 Jun 07 22:05:11.360855 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 194/367] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:05:11 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1408 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:05:11.361048 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-892a70e6-c4ae-40f9-aeff-49861fa42e49 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:11.361048 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-892a70e6-c4ae-40f9-aeff-49861fa42e49 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 12d312ce-b6a9-4f85-990c-772d64ee228f] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:11.365108 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-892a70e6-c4ae-40f9-aeff-49861fa42e49 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:11.365705 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-892a70e6-c4ae-40f9-aeff-49861fa42e49 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:11.366583 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-892a70e6-c4ae-40f9-aeff-49861fa42e49 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:11.367014 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-892a70e6-c4ae-40f9-aeff-49861fa42e49 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:11.432253 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-892a70e6-c4ae-40f9-aeff-49861fa42e49 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce9ec4aea9449d3890f6dbb93f97968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc558dd3848d4d3d950d7cd408e19741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:11.439783 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-892a70e6-c4ae-40f9-aeff-49861fa42e49 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "GET /compute/v2.1/servers/12d312ce-b6a9-4f85-990c-772d64ee228f" status: 200 len: 1266 microversion: 2.1 time: 0.086043 Jun 07 22:05:11.440388 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 174/368] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:11 2022] GET /compute/v2.1/servers/12d312ce-b6a9-4f85-990c-772d64ee228f => generated 1266 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:05:11.690054 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-c1c39252-0a44-44cc-a8b2-4b256d340c8e tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:11.690663 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-c1c39252-0a44-44cc-a8b2-4b256d340c8e tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] [instance: 4d0577c2-268e-4615-a373-379b4979836d] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:11.696830 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c1c39252-0a44-44cc-a8b2-4b256d340c8e tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:11.697282 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c1c39252-0a44-44cc-a8b2-4b256d340c8e tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:11.698046 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c1c39252-0a44-44cc-a8b2-4b256d340c8e tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:11.698483 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c1c39252-0a44-44cc-a8b2-4b256d340c8e tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:11.729495 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c1c39252-0a44-44cc-a8b2-4b256d340c8e tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:11.729946 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c1c39252-0a44-44cc-a8b2-4b256d340c8e tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:11.730391 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.objects.instance [None req-c1c39252-0a44-44cc-a8b2-4b256d340c8e tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lazy-loading 'fault' on Instance uuid 4d0577c2-268e-4615-a373-379b4979836d {{(pid=117971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 22:05:11.769996 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-c1c39252-0a44-44cc-a8b2-4b256d340c8e tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03864707f284a14ad9726c4023f32b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f240f9b198124b58826697af9f8ab205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:11.778262 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-c1c39252-0a44-44cc-a8b2-4b256d340c8e tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] 10.222.0.13 "GET /compute/v2.1/servers/4d0577c2-268e-4615-a373-379b4979836d" status: 200 len: 1305 microversion: 2.1 time: 0.092177 Jun 07 22:05:11.778821 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 195/369] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:11 2022] GET /compute/v2.1/servers/4d0577c2-268e-4615-a373-379b4979836d => generated 1305 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:05:11.797780 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-1c5dc889-3f00-4d73-9136-6961f3c7e5fe tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:11.798378 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-1c5dc889-3f00-4d73-9136-6961f3c7e5fe tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:11.800328 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:05:11.806740 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1c5dc889-3f00-4d73-9136-6961f3c7e5fe tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:11.807192 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1c5dc889-3f00-4d73-9136-6961f3c7e5fe tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:11.808012 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1c5dc889-3f00-4d73-9136-6961f3c7e5fe tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:11.808430 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1c5dc889-3f00-4d73-9136-6961f3c7e5fe tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:12.024547 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-1c5dc889-3f00-4d73-9136-6961f3c7e5fe tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:12.031990 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-1c5dc889-3f00-4d73-9136-6961f3c7e5fe tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1521 microversion: 2.1 time: 0.238030 Jun 07 22:05:12.032557 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 175/370] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:11 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:05:12.371170 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-99a9f787-f41a-4c0a-9160-f08f8bfa7d9a tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:12.372706 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-99a9f787-f41a-4c0a-9160-f08f8bfa7d9a tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:12.379298 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-99a9f787-f41a-4c0a-9160-f08f8bfa7d9a tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:12.380000 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-99a9f787-f41a-4c0a-9160-f08f8bfa7d9a tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:12.380777 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-99a9f787-f41a-4c0a-9160-f08f8bfa7d9a tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:12.381213 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-99a9f787-f41a-4c0a-9160-f08f8bfa7d9a tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:12.456719 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-1b5f7292-1379-42d2-9af9-696eb8b55f90 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:12.457320 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-1b5f7292-1379-42d2-9af9-696eb8b55f90 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 12d312ce-b6a9-4f85-990c-772d64ee228f] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:12.464605 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1b5f7292-1379-42d2-9af9-696eb8b55f90 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:12.465048 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1b5f7292-1379-42d2-9af9-696eb8b55f90 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:12.466256 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1b5f7292-1379-42d2-9af9-696eb8b55f90 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:12.466879 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1b5f7292-1379-42d2-9af9-696eb8b55f90 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:12.530719 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-99a9f787-f41a-4c0a-9160-f08f8bfa7d9a tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:12.544684 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-99a9f787-f41a-4c0a-9160-f08f8bfa7d9a tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:12.546373 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-99a9f787-f41a-4c0a-9160-f08f8bfa7d9a tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:12.547632 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-99a9f787-f41a-4c0a-9160-f08f8bfa7d9a tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1408 microversion: 2.20 time: 0.181323 Jun 07 22:05:12.548292 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 196/371] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:05:12 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1408 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:05:12.794425 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-43fc97bb-c65a-4f46-bdad-3dba2e915a49 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:12.795130 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-43fc97bb-c65a-4f46-bdad-3dba2e915a49 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] [instance: 4d0577c2-268e-4615-a373-379b4979836d] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:12.800996 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-43fc97bb-c65a-4f46-bdad-3dba2e915a49 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:12.801438 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-43fc97bb-c65a-4f46-bdad-3dba2e915a49 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:12.802181 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-43fc97bb-c65a-4f46-bdad-3dba2e915a49 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:12.802605 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-43fc97bb-c65a-4f46-bdad-3dba2e915a49 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:12.814575 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-1b5f7292-1379-42d2-9af9-696eb8b55f90 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce9ec4aea9449d3890f6dbb93f97968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc558dd3848d4d3d950d7cd408e19741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:12.817096 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.wsgi [None req-43fc97bb-c65a-4f46-bdad-3dba2e915a49 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] HTTP exception thrown: Instance 4d0577c2-268e-4615-a373-379b4979836d could not be found. Jun 07 22:05:12.819419 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-43fc97bb-c65a-4f46-bdad-3dba2e915a49 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Request method failure captured: Jun 07 22:05:12.819419 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: request: GET /compute/v2.1/servers/4d0577c2-268e-4615-a373-379b4979836d HTTP/1.1 Jun 07 22:05:12.819419 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Accept: application/json Jun 07 22:05:12.819419 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Accept-Encoding: identity Jun 07 22:05:12.819419 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Connection: close Jun 07 22:05:12.819419 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Content-Length: 0 Jun 07 22:05:12.819419 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Content-Type: application/json Jun 07 22:05:12.819419 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Host: 10.222.0.13 Jun 07 22:05:12.819419 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Openstack-System-Scope: None Jun 07 22:05:12.819419 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: User-Agent: python-urllib3/1.26.9 Jun 07 22:05:12.819419 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Auth-Token: gAAAAABin8t1_NT09AA4XWOcqQjVEunrbksv4qmtqcfoWIhgJXbKZdt-i2hE--rNQM2V2ZzSj-d1Hc4co6eoCzi5RS_pIYALEuERtwIBAaDuBZEANzklvbdv8SoONasJYvXoe6LgDzmuV5nBIP7tWO9lr1Ifx6Pu4RzjHil6j_eJYdqO3GzwJVQ Jun 07 22:05:12.819419 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Domain-Id: None Jun 07 22:05:12.819419 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Domain-Name: None Jun 07 22:05:12.819419 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Identity-Status: Confirmed Jun 07 22:05:12.819419 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Is-Admin-Project: True Jun 07 22:05:12.819419 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Domain-Id: default Jun 07 22:05:12.819419 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Domain-Name: Default Jun 07 22:05:12.819419 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Id: f240f9b198124b58826697af9f8ab205 Jun 07 22:05:12.819419 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Name: tempest-VolumesNegativeTest-146767143 Jun 07 22:05:12.819419 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Role: member,reader Jun 07 22:05:12.819419 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Roles: member,reader Jun 07 22:05:12.821607 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f240f9b198124b58826697af9f8ab205"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_f240f9b198124b58826697af9f8ab205"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f240f9b198124b58826697af9f8ab205"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/f240f9b198124b58826697af9f8ab205"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}] Jun 07 22:05:12.821607 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant: tempest-VolumesNegativeTest-146767143 Jun 07 22:05:12.821607 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant-Id: f240f9b198124b58826697af9f8ab205 Jun 07 22:05:12.821607 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant-Name: tempest-VolumesNegativeTest-146767143 Jun 07 22:05:12.821607 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User: tempest-VolumesNegativeTest-146767143-project Jun 07 22:05:12.821607 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Domain-Id: default Jun 07 22:05:12.821607 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Domain-Name: Default Jun 07 22:05:12.821607 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Id: d03864707f284a14ad9726c4023f32b8 Jun 07 22:05:12.821607 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Name: tempest-VolumesNegativeTest-146767143-project Jun 07 22:05:12.821607 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: method: > Jun 07 22:05:12.821607 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: exception: Instance 4d0577c2-268e-4615-a373-379b4979836d could not be found. Jun 07 22:05:12.821607 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: action_args: {'id': '4d0577c2-268e-4615-a373-379b4979836d'} Jun 07 22:05:12.822341 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 22:05:12.822341 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:05:12.822341 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 22:05:12.822341 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 22:05:12.822341 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 22:05:12.822341 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 22:05:12.822341 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 22:05:12.822341 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 22:05:12.822341 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 22:05:12.822341 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 22:05:12.822341 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d0577c2-268e-4615-a373-379b4979836d could not be found. Jun 07 22:05:12.822341 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:05:12.822341 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:05:12.822341 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:05:12.822341 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:05:12.822341 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:05:12.822341 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:05:12.822341 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 22:05:12.822341 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 22:05:12.822341 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 22:05:12.823510 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 22:05:12.823510 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 22:05:12.823510 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 22:05:12.823510 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 22:05:12.823510 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 22:05:12.823510 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 22:05:12.823510 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 22:05:12.823510 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d0577c2-268e-4615-a373-379b4979836d could not be found. Jun 07 22:05:12.823510 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:05:12.823510 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:05:12.823510 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:05:12.823510 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:05:12.823510 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:05:12.823510 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:05:12.823510 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 22:05:12.823510 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 22:05:12.823510 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d0577c2-268e-4615-a373-379b4979836d could not be found. Jun 07 22:05:12.823510 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:05:12.825153 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-1b5f7292-1379-42d2-9af9-696eb8b55f90 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "GET /compute/v2.1/servers/12d312ce-b6a9-4f85-990c-772d64ee228f" status: 200 len: 1272 microversion: 2.1 time: 0.372281 Jun 07 22:05:12.825978 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-43fc97bb-c65a-4f46-bdad-3dba2e915a49 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] Returning 404 to user: Instance 4d0577c2-268e-4615-a373-379b4979836d could not be found. {{(pid=117971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 22:05:12.826391 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 176/372] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:12 2022] GET /compute/v2.1/servers/12d312ce-b6a9-4f85-990c-772d64ee228f => generated 1272 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:05:12.827134 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-43fc97bb-c65a-4f46-bdad-3dba2e915a49 tempest-VolumesNegativeTest-146767143 tempest-VolumesNegativeTest-146767143-project] 10.222.0.13 "GET /compute/v2.1/servers/4d0577c2-268e-4615-a373-379b4979836d" status: 404 len: 111 microversion: 2.1 time: 0.036608 Jun 07 22:05:12.827845 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 197/373] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:12 2022] GET /compute/v2.1/servers/4d0577c2-268e-4615-a373-379b4979836d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 07 22:05:13.049195 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-30de60d7-a3f7-48f4-bf7d-c8e1b604284e tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:13.050199 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-30de60d7-a3f7-48f4-bf7d-c8e1b604284e tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:13.080138 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-30de60d7-a3f7-48f4-bf7d-c8e1b604284e tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:13.081414 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-30de60d7-a3f7-48f4-bf7d-c8e1b604284e tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:13.083035 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-30de60d7-a3f7-48f4-bf7d-c8e1b604284e tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:13.083523 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-30de60d7-a3f7-48f4-bf7d-c8e1b604284e tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:13.088756 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_cell1:SELECT=100 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:05:13.427552 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-30de60d7-a3f7-48f4-bf7d-c8e1b604284e tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:13.435440 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-30de60d7-a3f7-48f4-bf7d-c8e1b604284e tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1521 microversion: 2.1 time: 0.390273 Jun 07 22:05:13.446135 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 177/374] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:13 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1521 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:05:13.552084 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [req-84cca950-deb9-4129-9d27-12427448da4f req-f54e8976-1c02-4898-99a9-bff2343fde5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07abb105-095a-47ad-8761-b5075254ac95", "tag": "dfed4201-3c81-4b15-b164-8dd355eaca62"}]} {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:05:13.563765 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-84cca950-deb9-4129-9d27-12427448da4f req-f54e8976-1c02-4898-99a9-bff2343fde5f service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:13.564381 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-84cca950-deb9-4129-9d27-12427448da4f req-f54e8976-1c02-4898-99a9-bff2343fde5f service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:13.568927 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-01458272-23ce-4c25-a411-5d800af59282 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:13.571499 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-01458272-23ce-4c25-a411-5d800af59282 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:13.578969 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-01458272-23ce-4c25-a411-5d800af59282 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:13.580442 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-01458272-23ce-4c25-a411-5d800af59282 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:13.581625 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-01458272-23ce-4c25-a411-5d800af59282 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:13.582254 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-01458272-23ce-4c25-a411-5d800af59282 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:13.584790 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.compute.server_external_events [req-84cca950-deb9-4129-9d27-12427448da4f req-f54e8976-1c02-4898-99a9-bff2343fde5f service nova] Creating event network-changed:dfed4201-3c81-4b15-b164-8dd355eaca62 for instance 07abb105-095a-47ad-8761-b5075254ac95 on hv-cinder-83552 Jun 07 22:05:13.592017 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [req-84cca950-deb9-4129-9d27-12427448da4f req-f54e8976-1c02-4898-99a9-bff2343fde5f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045995 Jun 07 22:05:13.593127 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 198/375] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:05:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:05:13.844110 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-b37c74a9-b327-4895-ac39-873c91d1edcd tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:13.845053 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-b37c74a9-b327-4895-ac39-873c91d1edcd tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 12d312ce-b6a9-4f85-990c-772d64ee228f] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:13.853892 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b37c74a9-b327-4895-ac39-873c91d1edcd tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:13.854700 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b37c74a9-b327-4895-ac39-873c91d1edcd tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:13.855745 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b37c74a9-b327-4895-ac39-873c91d1edcd tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:13.856252 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b37c74a9-b327-4895-ac39-873c91d1edcd tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:13.933290 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-b37c74a9-b327-4895-ac39-873c91d1edcd tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce9ec4aea9449d3890f6dbb93f97968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc558dd3848d4d3d950d7cd408e19741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:13.944774 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-b37c74a9-b327-4895-ac39-873c91d1edcd tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "GET /compute/v2.1/servers/12d312ce-b6a9-4f85-990c-772d64ee228f" status: 200 len: 1272 microversion: 2.1 time: 0.105415 Jun 07 22:05:13.946431 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 199/376] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:13 2022] GET /compute/v2.1/servers/12d312ce-b6a9-4f85-990c-772d64ee228f => generated 1272 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:05:14.056595 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-01458272-23ce-4c25-a411-5d800af59282 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:14.071753 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-01458272-23ce-4c25-a411-5d800af59282 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:14.073498 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-01458272-23ce-4c25-a411-5d800af59282 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:14.074658 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-01458272-23ce-4c25-a411-5d800af59282 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1408 microversion: 2.20 time: 0.511242 Jun 07 22:05:14.075230 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 178/377] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:05:13 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1408 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:05:14.452775 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-90806878-ede6-465d-9b7a-c171cd730ab8 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:14.453387 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-90806878-ede6-465d-9b7a-c171cd730ab8 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:14.465196 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-90806878-ede6-465d-9b7a-c171cd730ab8 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:14.465196 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-90806878-ede6-465d-9b7a-c171cd730ab8 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:14.465196 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-90806878-ede6-465d-9b7a-c171cd730ab8 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:14.465196 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-90806878-ede6-465d-9b7a-c171cd730ab8 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:14.613544 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-90806878-ede6-465d-9b7a-c171cd730ab8 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:14.622277 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-90806878-ede6-465d-9b7a-c171cd730ab8 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1521 microversion: 2.1 time: 0.173512 Jun 07 22:05:14.622845 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 200/378] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:14 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:05:14.962413 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-d4b37baf-8795-43f7-9fb7-fdd6815ce441 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:14.963074 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-d4b37baf-8795-43f7-9fb7-fdd6815ce441 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 12d312ce-b6a9-4f85-990c-772d64ee228f] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:14.969217 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d4b37baf-8795-43f7-9fb7-fdd6815ce441 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:14.971898 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d4b37baf-8795-43f7-9fb7-fdd6815ce441 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:14.972869 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d4b37baf-8795-43f7-9fb7-fdd6815ce441 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:14.973575 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d4b37baf-8795-43f7-9fb7-fdd6815ce441 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:15.093687 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-e7a7b5be-d10b-4eb0-b641-a51ebcd8ef63 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:15.094589 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-e7a7b5be-d10b-4eb0-b641-a51ebcd8ef63 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:15.105734 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e7a7b5be-d10b-4eb0-b641-a51ebcd8ef63 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:15.106115 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e7a7b5be-d10b-4eb0-b641-a51ebcd8ef63 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:15.106886 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e7a7b5be-d10b-4eb0-b641-a51ebcd8ef63 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:15.107333 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e7a7b5be-d10b-4eb0-b641-a51ebcd8ef63 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:15.227410 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-d4b37baf-8795-43f7-9fb7-fdd6815ce441 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce9ec4aea9449d3890f6dbb93f97968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc558dd3848d4d3d950d7cd408e19741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:15.242638 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-d4b37baf-8795-43f7-9fb7-fdd6815ce441 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "GET /compute/v2.1/servers/12d312ce-b6a9-4f85-990c-772d64ee228f" status: 200 len: 1314 microversion: 2.1 time: 0.284156 Jun 07 22:05:15.243586 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 179/379] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:14 2022] GET /compute/v2.1/servers/12d312ce-b6a9-4f85-990c-772d64ee228f => generated 1314 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:05:15.271597 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-e7a7b5be-d10b-4eb0-b641-a51ebcd8ef63 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:15.280466 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-e7a7b5be-d10b-4eb0-b641-a51ebcd8ef63 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:15.281942 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-e7a7b5be-d10b-4eb0-b641-a51ebcd8ef63 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:15.295186 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-e7a7b5be-d10b-4eb0-b641-a51ebcd8ef63 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1408 microversion: 2.20 time: 0.194610 Jun 07 22:05:15.296188 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 201/380] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:05:15 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1408 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:05:15.640228 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-034d6f2b-675e-4dc5-9bcb-2727c79f0ecb tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:15.640387 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-034d6f2b-675e-4dc5-9bcb-2727c79f0ecb tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:15.646614 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-034d6f2b-675e-4dc5-9bcb-2727c79f0ecb tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:15.647053 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-034d6f2b-675e-4dc5-9bcb-2727c79f0ecb tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:15.647839 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-034d6f2b-675e-4dc5-9bcb-2727c79f0ecb tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:15.649184 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-034d6f2b-675e-4dc5-9bcb-2727c79f0ecb tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:15.971784 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-034d6f2b-675e-4dc5-9bcb-2727c79f0ecb tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:15.979750 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-034d6f2b-675e-4dc5-9bcb-2727c79f0ecb tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1501 microversion: 2.1 time: 0.344748 Jun 07 22:05:15.980321 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 180/381] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:15 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1501 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:05:15.996302 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-44be0f31-af6f-429a-955f-1f36452c05b8 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:15.997035 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-44be0f31-af6f-429a-955f-1f36452c05b8 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 92b3a56b-7d09-4772-b1e4-c75b3971f7a5] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:16.003556 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-44be0f31-af6f-429a-955f-1f36452c05b8 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:16.004102 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-44be0f31-af6f-429a-955f-1f36452c05b8 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:16.004966 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-44be0f31-af6f-429a-955f-1f36452c05b8 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:16.005466 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-44be0f31-af6f-429a-955f-1f36452c05b8 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:16.137433 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-44be0f31-af6f-429a-955f-1f36452c05b8 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:16.144983 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-44be0f31-af6f-429a-955f-1f36452c05b8 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/92b3a56b-7d09-4772-b1e4-c75b3971f7a5" status: 200 len: 1515 microversion: 2.1 time: 0.153458 Jun 07 22:05:16.145636 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 202/382] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:15 2022] GET /compute/v2.1/servers/92b3a56b-7d09-4772-b1e4-c75b3971f7a5 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:05:16.262376 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-48353f13-1b1a-42b2-89bc-0ae166c87a6b tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:16.263252 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-48353f13-1b1a-42b2-89bc-0ae166c87a6b tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 12d312ce-b6a9-4f85-990c-772d64ee228f] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:16.270710 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-48353f13-1b1a-42b2-89bc-0ae166c87a6b tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:16.271153 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-48353f13-1b1a-42b2-89bc-0ae166c87a6b tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:16.272679 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-48353f13-1b1a-42b2-89bc-0ae166c87a6b tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:16.273094 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-48353f13-1b1a-42b2-89bc-0ae166c87a6b tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:16.297291 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [req-972558c3-65f8-48ee-831d-dbce278dfb74 req-bc32000a-481e-4f5e-b6b0-1bbf68d6612c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12d312ce-b6a9-4f85-990c-772d64ee228f", "tag": "38b9b5c5-93c7-4f09-b333-b20420e7f7ab"}]} {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:05:16.311486 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-972558c3-65f8-48ee-831d-dbce278dfb74 req-bc32000a-481e-4f5e-b6b0-1bbf68d6612c service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:16.315116 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-972558c3-65f8-48ee-831d-dbce278dfb74 req-bc32000a-481e-4f5e-b6b0-1bbf68d6612c service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:16.336390 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.compute.server_external_events [req-972558c3-65f8-48ee-831d-dbce278dfb74 req-bc32000a-481e-4f5e-b6b0-1bbf68d6612c service nova] Creating event network-changed:38b9b5c5-93c7-4f09-b333-b20420e7f7ab for instance 12d312ce-b6a9-4f85-990c-772d64ee228f on hv-cinder-83552 Jun 07 22:05:16.344344 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [req-972558c3-65f8-48ee-831d-dbce278dfb74 req-bc32000a-481e-4f5e-b6b0-1bbf68d6612c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052411 Jun 07 22:05:16.344938 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 203/383] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:05:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 22:05:16.352258 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-a4b3098e-55f2-4470-b0a9-09c5bae193b2 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:16.353635 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-a4b3098e-55f2-4470-b0a9-09c5bae193b2 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:16.356097 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:05:16.365331 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a4b3098e-55f2-4470-b0a9-09c5bae193b2 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:16.365903 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a4b3098e-55f2-4470-b0a9-09c5bae193b2 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:16.369162 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a4b3098e-55f2-4470-b0a9-09c5bae193b2 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:16.369612 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a4b3098e-55f2-4470-b0a9-09c5bae193b2 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:16.480823 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-48353f13-1b1a-42b2-89bc-0ae166c87a6b tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce9ec4aea9449d3890f6dbb93f97968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc558dd3848d4d3d950d7cd408e19741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:16.489956 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-48353f13-1b1a-42b2-89bc-0ae166c87a6b tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "GET /compute/v2.1/servers/12d312ce-b6a9-4f85-990c-772d64ee228f" status: 200 len: 1314 microversion: 2.1 time: 0.233446 Jun 07 22:05:16.490759 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 181/384] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:16 2022] GET /compute/v2.1/servers/12d312ce-b6a9-4f85-990c-772d64ee228f => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:05:16.545864 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_cell0:SELECT=2 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:05:16.550150 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-a4b3098e-55f2-4470-b0a9-09c5bae193b2 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:16.560075 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-a4b3098e-55f2-4470-b0a9-09c5bae193b2 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:16.561567 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-a4b3098e-55f2-4470-b0a9-09c5bae193b2 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:16.562652 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-a4b3098e-55f2-4470-b0a9-09c5bae193b2 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1408 microversion: 2.20 time: 0.216470 Jun 07 22:05:16.563198 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 204/385] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:05:16 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1408 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:05:17.512267 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-82be416b-a1b9-43e2-a9c2-84bd75338bbc tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:17.513015 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-82be416b-a1b9-43e2-a9c2-84bd75338bbc tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 12d312ce-b6a9-4f85-990c-772d64ee228f] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:17.519223 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-82be416b-a1b9-43e2-a9c2-84bd75338bbc tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:17.519685 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-82be416b-a1b9-43e2-a9c2-84bd75338bbc tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:17.520427 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-82be416b-a1b9-43e2-a9c2-84bd75338bbc tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:17.520852 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-82be416b-a1b9-43e2-a9c2-84bd75338bbc tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:17.580390 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-67e43ded-21f5-447f-8160-381df77e0f2a tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:17.581111 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-67e43ded-21f5-447f-8160-381df77e0f2a tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:17.588211 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-67e43ded-21f5-447f-8160-381df77e0f2a tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:17.588951 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-67e43ded-21f5-447f-8160-381df77e0f2a tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:17.590167 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-67e43ded-21f5-447f-8160-381df77e0f2a tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:17.591211 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-67e43ded-21f5-447f-8160-381df77e0f2a tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:17.651995 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-82be416b-a1b9-43e2-a9c2-84bd75338bbc tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce9ec4aea9449d3890f6dbb93f97968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc558dd3848d4d3d950d7cd408e19741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:17.659515 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-82be416b-a1b9-43e2-a9c2-84bd75338bbc tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "GET /compute/v2.1/servers/12d312ce-b6a9-4f85-990c-772d64ee228f" status: 200 len: 1314 microversion: 2.1 time: 0.151958 Jun 07 22:05:17.660081 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 182/386] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:17 2022] GET /compute/v2.1/servers/12d312ce-b6a9-4f85-990c-772d64ee228f => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:05:17.738260 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-67e43ded-21f5-447f-8160-381df77e0f2a tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:17.746630 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-67e43ded-21f5-447f-8160-381df77e0f2a tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:17.748139 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-67e43ded-21f5-447f-8160-381df77e0f2a tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:17.749219 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-67e43ded-21f5-447f-8160-381df77e0f2a tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1408 microversion: 2.20 time: 0.172891 Jun 07 22:05:17.749765 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 205/387] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:05:17 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1408 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 22:05:18.676757 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-f2a418e6-18c5-411d-ab47-61254d61dbcf tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:18.677574 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-f2a418e6-18c5-411d-ab47-61254d61dbcf tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 12d312ce-b6a9-4f85-990c-772d64ee228f] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:18.681109 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_cell0:SELECT=2 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:05:18.681884 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_cell0:SELECT=12 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:05:18.687771 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f2a418e6-18c5-411d-ab47-61254d61dbcf tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:18.688215 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f2a418e6-18c5-411d-ab47-61254d61dbcf tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:18.688977 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f2a418e6-18c5-411d-ab47-61254d61dbcf tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:18.689408 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f2a418e6-18c5-411d-ab47-61254d61dbcf tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:18.768088 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-f49e83ec-97ef-4b1b-88ac-94b2cd3f0274 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:18.768778 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-f49e83ec-97ef-4b1b-88ac-94b2cd3f0274 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:18.770985 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_cell0:SELECT=8 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:05:18.777525 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-f49e83ec-97ef-4b1b-88ac-94b2cd3f0274 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:18.777990 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-f49e83ec-97ef-4b1b-88ac-94b2cd3f0274 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:18.778921 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-f49e83ec-97ef-4b1b-88ac-94b2cd3f0274 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:18.779377 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-f49e83ec-97ef-4b1b-88ac-94b2cd3f0274 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:18.831773 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-f2a418e6-18c5-411d-ab47-61254d61dbcf tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce9ec4aea9449d3890f6dbb93f97968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc558dd3848d4d3d950d7cd408e19741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:18.840509 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-f2a418e6-18c5-411d-ab47-61254d61dbcf tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "GET /compute/v2.1/servers/12d312ce-b6a9-4f85-990c-772d64ee228f" status: 200 len: 1314 microversion: 2.1 time: 0.167594 Jun 07 22:05:18.841077 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 183/388] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:18 2022] GET /compute/v2.1/servers/12d312ce-b6a9-4f85-990c-772d64ee228f => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:05:18.913787 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-f49e83ec-97ef-4b1b-88ac-94b2cd3f0274 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:18.917762 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_cell1:SELECT=100 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:05:18.923142 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-f49e83ec-97ef-4b1b-88ac-94b2cd3f0274 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:18.924669 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-f49e83ec-97ef-4b1b-88ac-94b2cd3f0274 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:18.925762 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-f49e83ec-97ef-4b1b-88ac-94b2cd3f0274 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1408 microversion: 2.20 time: 0.161729 Jun 07 22:05:18.926312 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 206/389] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:05:18 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1408 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 22:05:19.702890 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-eb5a84a3-ca64-436e-b661-40caf3a1d060 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:05:19.703911 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-eb5a84a3-ca64-436e-b661-40caf3a1d060 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 92b3a56b-7d09-4772-b1e4-c75b3971f7a5] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:19.709843 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-eb5a84a3-ca64-436e-b661-40caf3a1d060 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:19.710280 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-eb5a84a3-ca64-436e-b661-40caf3a1d060 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:19.711173 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-eb5a84a3-ca64-436e-b661-40caf3a1d060 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:19.711949 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-eb5a84a3-ca64-436e-b661-40caf3a1d060 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:19.734843 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.objects.instance [None req-eb5a84a3-ca64-436e-b661-40caf3a1d060 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lazy-loading 'flavor' on Instance uuid 92b3a56b-7d09-4772-b1e4-c75b3971f7a5 {{(pid=117970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 22:05:19.850126 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-eb5a84a3-ca64-436e-b661-40caf3a1d060 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "POST /compute/v2.1/servers/92b3a56b-7d09-4772-b1e4-c75b3971f7a5/action" status: 200 len: 32 microversion: 2.1 time: 0.151180 Jun 07 22:05:19.850732 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 184/390] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Jun 7 22:05:19 2022] POST /compute/v2.1/servers/92b3a56b-7d09-4772-b1e4-c75b3971f7a5/action => generated 32 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 07 22:05:19.857631 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-1631591b-3771-4744-a017-a821eabab39d tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:19.858241 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-1631591b-3771-4744-a017-a821eabab39d tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 12d312ce-b6a9-4f85-990c-772d64ee228f] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:19.860633 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-fbf4d1b4-17f6-41dc-9c87-6786d91d7396 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:19.861363 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-fbf4d1b4-17f6-41dc-9c87-6786d91d7396 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 92b3a56b-7d09-4772-b1e4-c75b3971f7a5] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:19.864878 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-1631591b-3771-4744-a017-a821eabab39d tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:19.865319 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-1631591b-3771-4744-a017-a821eabab39d tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:19.866093 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-1631591b-3771-4744-a017-a821eabab39d tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:19.866519 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-1631591b-3771-4744-a017-a821eabab39d tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:19.868023 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-fbf4d1b4-17f6-41dc-9c87-6786d91d7396 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:19.868477 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-fbf4d1b4-17f6-41dc-9c87-6786d91d7396 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:19.869326 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-fbf4d1b4-17f6-41dc-9c87-6786d91d7396 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:19.869949 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-fbf4d1b4-17f6-41dc-9c87-6786d91d7396 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:19.999627 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-1631591b-3771-4744-a017-a821eabab39d tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce9ec4aea9449d3890f6dbb93f97968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc558dd3848d4d3d950d7cd408e19741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:19.999839 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-fbf4d1b4-17f6-41dc-9c87-6786d91d7396 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:20.006930 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-1631591b-3771-4744-a017-a821eabab39d tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "GET /compute/v2.1/servers/12d312ce-b6a9-4f85-990c-772d64ee228f" status: 200 len: 1314 microversion: 2.1 time: 0.153260 Jun 07 22:05:20.007228 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-fbf4d1b4-17f6-41dc-9c87-6786d91d7396 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/92b3a56b-7d09-4772-b1e4-c75b3971f7a5" status: 200 len: 1521 microversion: 2.1 time: 0.150588 Jun 07 22:05:20.007619 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 207/391] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:19 2022] GET /compute/v2.1/servers/12d312ce-b6a9-4f85-990c-772d64ee228f => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:05:20.011527 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 185/392] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:19 2022] GET /compute/v2.1/servers/92b3a56b-7d09-4772-b1e4-c75b3971f7a5 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:05:20.012334 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-87660d1c-9481-4a4a-97cf-a150a939c297 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:20.012927 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-87660d1c-9481-4a4a-97cf-a150a939c297 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:20.019718 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-87660d1c-9481-4a4a-97cf-a150a939c297 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:20.020176 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-87660d1c-9481-4a4a-97cf-a150a939c297 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:20.020938 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-87660d1c-9481-4a4a-97cf-a150a939c297 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:20.021372 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-87660d1c-9481-4a4a-97cf-a150a939c297 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:20.159696 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-87660d1c-9481-4a4a-97cf-a150a939c297 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:20.168308 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-87660d1c-9481-4a4a-97cf-a150a939c297 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:20.169813 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-87660d1c-9481-4a4a-97cf-a150a939c297 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:20.170905 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-87660d1c-9481-4a4a-97cf-a150a939c297 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1408 microversion: 2.20 time: 0.162168 Jun 07 22:05:20.171473 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 208/393] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:05:20 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1408 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:05:21.023886 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-c3730583-508c-415c-adc6-8ae9117817b8 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:21.024484 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-c3730583-508c-415c-adc6-8ae9117817b8 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 12d312ce-b6a9-4f85-990c-772d64ee228f] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:21.028435 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-43de2819-33c8-40a7-8c74-96ee29fe9d89 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:21.029041 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-43de2819-33c8-40a7-8c74-96ee29fe9d89 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 92b3a56b-7d09-4772-b1e4-c75b3971f7a5] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:21.035089 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c3730583-508c-415c-adc6-8ae9117817b8 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:21.035555 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c3730583-508c-415c-adc6-8ae9117817b8 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:21.036328 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c3730583-508c-415c-adc6-8ae9117817b8 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:21.036542 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-43de2819-33c8-40a7-8c74-96ee29fe9d89 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:21.036762 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c3730583-508c-415c-adc6-8ae9117817b8 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:21.037151 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-43de2819-33c8-40a7-8c74-96ee29fe9d89 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:21.038128 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-43de2819-33c8-40a7-8c74-96ee29fe9d89 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:21.038634 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-43de2819-33c8-40a7-8c74-96ee29fe9d89 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:21.215762 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-43de2819-33c8-40a7-8c74-96ee29fe9d89 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:21.230759 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-43de2819-33c8-40a7-8c74-96ee29fe9d89 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/92b3a56b-7d09-4772-b1e4-c75b3971f7a5" status: 200 len: 1521 microversion: 2.1 time: 0.206589 Jun 07 22:05:21.232331 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 209/394] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:21 2022] GET /compute/v2.1/servers/92b3a56b-7d09-4772-b1e4-c75b3971f7a5 => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:05:21.247103 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-22dedd22-7b34-4f0b-bea9-35797e6f5490 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:21.248000 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-22dedd22-7b34-4f0b-bea9-35797e6f5490 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:21.256858 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-22dedd22-7b34-4f0b-bea9-35797e6f5490 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:21.257568 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-22dedd22-7b34-4f0b-bea9-35797e6f5490 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:21.258369 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-22dedd22-7b34-4f0b-bea9-35797e6f5490 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:21.258813 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-22dedd22-7b34-4f0b-bea9-35797e6f5490 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:21.422925 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-22dedd22-7b34-4f0b-bea9-35797e6f5490 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:21.432259 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-22dedd22-7b34-4f0b-bea9-35797e6f5490 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:21.433777 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-22dedd22-7b34-4f0b-bea9-35797e6f5490 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:21.435070 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-22dedd22-7b34-4f0b-bea9-35797e6f5490 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1408 microversion: 2.20 time: 0.200841 Jun 07 22:05:21.445961 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 210/395] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:05:21 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1408 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:05:21.512872 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-c3730583-508c-415c-adc6-8ae9117817b8 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce9ec4aea9449d3890f6dbb93f97968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc558dd3848d4d3d950d7cd408e19741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:21.520204 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-c3730583-508c-415c-adc6-8ae9117817b8 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "GET /compute/v2.1/servers/12d312ce-b6a9-4f85-990c-772d64ee228f" status: 200 len: 1314 microversion: 2.1 time: 0.500109 Jun 07 22:05:21.521086 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 186/396] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:21 2022] GET /compute/v2.1/servers/12d312ce-b6a9-4f85-990c-772d64ee228f => generated 1314 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:05:22.249221 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-4ac28b23-15de-43e8-93ee-4a2b1a7eb7f7 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:22.250479 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-4ac28b23-15de-43e8-93ee-4a2b1a7eb7f7 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 92b3a56b-7d09-4772-b1e4-c75b3971f7a5] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:22.257030 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-4ac28b23-15de-43e8-93ee-4a2b1a7eb7f7 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:22.257493 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-4ac28b23-15de-43e8-93ee-4a2b1a7eb7f7 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:22.258540 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-4ac28b23-15de-43e8-93ee-4a2b1a7eb7f7 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:22.258975 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-4ac28b23-15de-43e8-93ee-4a2b1a7eb7f7 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:22.407178 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-4ac28b23-15de-43e8-93ee-4a2b1a7eb7f7 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:22.416021 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-4ac28b23-15de-43e8-93ee-4a2b1a7eb7f7 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/92b3a56b-7d09-4772-b1e4-c75b3971f7a5" status: 200 len: 1521 microversion: 2.1 time: 0.170767 Jun 07 22:05:22.416901 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 211/397] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:22 2022] GET /compute/v2.1/servers/92b3a56b-7d09-4772-b1e4-c75b3971f7a5 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:05:22.453176 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-3f43ed95-90ac-4f18-9867-14e91a88bc3d tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:22.454502 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-3f43ed95-90ac-4f18-9867-14e91a88bc3d tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:22.460603 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-3f43ed95-90ac-4f18-9867-14e91a88bc3d tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:22.461651 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-3f43ed95-90ac-4f18-9867-14e91a88bc3d tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:22.462426 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-3f43ed95-90ac-4f18-9867-14e91a88bc3d tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:22.462861 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-3f43ed95-90ac-4f18-9867-14e91a88bc3d tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:22.540850 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-1841a6e4-c952-4c90-8344-7cd425bd60fb tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:22.541460 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-1841a6e4-c952-4c90-8344-7cd425bd60fb tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 12d312ce-b6a9-4f85-990c-772d64ee228f] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:22.552285 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-1841a6e4-c952-4c90-8344-7cd425bd60fb tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:22.553271 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-1841a6e4-c952-4c90-8344-7cd425bd60fb tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:22.554343 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-1841a6e4-c952-4c90-8344-7cd425bd60fb tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:22.555723 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-1841a6e4-c952-4c90-8344-7cd425bd60fb tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:22.723535 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-1841a6e4-c952-4c90-8344-7cd425bd60fb tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce9ec4aea9449d3890f6dbb93f97968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc558dd3848d4d3d950d7cd408e19741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:22.732183 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-1841a6e4-c952-4c90-8344-7cd425bd60fb tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "GET /compute/v2.1/servers/12d312ce-b6a9-4f85-990c-772d64ee228f" status: 200 len: 1314 microversion: 2.1 time: 0.197257 Jun 07 22:05:22.733053 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 212/398] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:22 2022] GET /compute/v2.1/servers/12d312ce-b6a9-4f85-990c-772d64ee228f => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:05:22.747822 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-3f43ed95-90ac-4f18-9867-14e91a88bc3d tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:22.764763 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-3f43ed95-90ac-4f18-9867-14e91a88bc3d tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:22.767054 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-3f43ed95-90ac-4f18-9867-14e91a88bc3d tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:22.768222 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-3f43ed95-90ac-4f18-9867-14e91a88bc3d tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1408 microversion: 2.20 time: 0.319057 Jun 07 22:05:22.779814 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 187/399] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:05:22 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1408 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:05:23.434521 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-3a9af6ee-bc56-4332-a531-7453e4f7bed6 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:23.435151 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-3a9af6ee-bc56-4332-a531-7453e4f7bed6 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 92b3a56b-7d09-4772-b1e4-c75b3971f7a5] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:23.441756 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-3a9af6ee-bc56-4332-a531-7453e4f7bed6 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:23.442212 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-3a9af6ee-bc56-4332-a531-7453e4f7bed6 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:23.442997 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-3a9af6ee-bc56-4332-a531-7453e4f7bed6 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:23.443433 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-3a9af6ee-bc56-4332-a531-7453e4f7bed6 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:23.588012 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-3a9af6ee-bc56-4332-a531-7453e4f7bed6 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:23.596516 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-3a9af6ee-bc56-4332-a531-7453e4f7bed6 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/92b3a56b-7d09-4772-b1e4-c75b3971f7a5" status: 200 len: 1521 microversion: 2.1 time: 0.166379 Jun 07 22:05:23.597237 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 213/400] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:23 2022] GET /compute/v2.1/servers/92b3a56b-7d09-4772-b1e4-c75b3971f7a5 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:05:23.698472 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [req-0bc3b7af-4a1b-4683-88ad-f43223fb061a req-318bc5a3-d0fa-4d49-abc2-4c89ac2f8979 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07abb105-095a-47ad-8761-b5075254ac95", "name": "network-vif-plugged", "status": "completed", "tag": "dfed4201-3c81-4b15-b164-8dd355eaca62"}]} {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:05:23.716129 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [req-0bc3b7af-4a1b-4683-88ad-f43223fb061a req-318bc5a3-d0fa-4d49-abc2-4c89ac2f8979 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:23.716659 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [req-0bc3b7af-4a1b-4683-88ad-f43223fb061a req-318bc5a3-d0fa-4d49-abc2-4c89ac2f8979 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:23.730143 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.compute.server_external_events [req-0bc3b7af-4a1b-4683-88ad-f43223fb061a req-318bc5a3-d0fa-4d49-abc2-4c89ac2f8979 service nova] Creating event network-vif-plugged:dfed4201-3c81-4b15-b164-8dd355eaca62 for instance 07abb105-095a-47ad-8761-b5075254ac95 on hv-cinder-83552 Jun 07 22:05:23.737892 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [req-0bc3b7af-4a1b-4683-88ad-f43223fb061a req-318bc5a3-d0fa-4d49-abc2-4c89ac2f8979 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048076 Jun 07 22:05:23.739743 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 188/401] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:05:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:05:23.753581 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-2598823a-0fe6-465b-8fc0-d504321f12b0 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:23.754672 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-2598823a-0fe6-465b-8fc0-d504321f12b0 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 12d312ce-b6a9-4f85-990c-772d64ee228f] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:23.762084 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-2598823a-0fe6-465b-8fc0-d504321f12b0 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:23.762790 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-2598823a-0fe6-465b-8fc0-d504321f12b0 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:23.763688 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-2598823a-0fe6-465b-8fc0-d504321f12b0 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:23.768251 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-2598823a-0fe6-465b-8fc0-d504321f12b0 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:23.786857 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-8e80c9c9-0267-488c-9be6-e711ec12e5d6 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:23.787881 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-8e80c9c9-0267-488c-9be6-e711ec12e5d6 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:23.794667 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-8e80c9c9-0267-488c-9be6-e711ec12e5d6 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:23.795503 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-8e80c9c9-0267-488c-9be6-e711ec12e5d6 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:23.796429 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-8e80c9c9-0267-488c-9be6-e711ec12e5d6 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:23.797198 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-8e80c9c9-0267-488c-9be6-e711ec12e5d6 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:23.964234 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-2598823a-0fe6-465b-8fc0-d504321f12b0 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce9ec4aea9449d3890f6dbb93f97968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc558dd3848d4d3d950d7cd408e19741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:23.977031 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-2598823a-0fe6-465b-8fc0-d504321f12b0 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "GET /compute/v2.1/servers/12d312ce-b6a9-4f85-990c-772d64ee228f" status: 200 len: 1314 microversion: 2.1 time: 0.226182 Jun 07 22:05:23.980037 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 214/402] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:23 2022] GET /compute/v2.1/servers/12d312ce-b6a9-4f85-990c-772d64ee228f => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:05:24.016237 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-8e80c9c9-0267-488c-9be6-e711ec12e5d6 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:24.038343 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-8e80c9c9-0267-488c-9be6-e711ec12e5d6 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:24.040165 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-8e80c9c9-0267-488c-9be6-e711ec12e5d6 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:24.041875 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-8e80c9c9-0267-488c-9be6-e711ec12e5d6 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1408 microversion: 2.20 time: 0.259649 Jun 07 22:05:24.043057 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 189/403] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:05:23 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1408 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:05:24.614449 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-e2f9a357-0ec6-44ff-bb23-491f5bbd2d8a tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:24.615055 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-e2f9a357-0ec6-44ff-bb23-491f5bbd2d8a tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 92b3a56b-7d09-4772-b1e4-c75b3971f7a5] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:24.628981 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e2f9a357-0ec6-44ff-bb23-491f5bbd2d8a tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:24.629702 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e2f9a357-0ec6-44ff-bb23-491f5bbd2d8a tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:24.630673 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e2f9a357-0ec6-44ff-bb23-491f5bbd2d8a tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:24.631265 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e2f9a357-0ec6-44ff-bb23-491f5bbd2d8a tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:24.991286 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-e2f9a357-0ec6-44ff-bb23-491f5bbd2d8a tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:24.996721 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-f66f7b64-450f-41e4-960d-02652adef416 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:24.997923 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-f66f7b64-450f-41e4-960d-02652adef416 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 12d312ce-b6a9-4f85-990c-772d64ee228f] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:25.001441 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-e2f9a357-0ec6-44ff-bb23-491f5bbd2d8a tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/92b3a56b-7d09-4772-b1e4-c75b3971f7a5" status: 200 len: 1521 microversion: 2.1 time: 0.390620 Jun 07 22:05:25.001864 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 215/404] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:24 2022] GET /compute/v2.1/servers/92b3a56b-7d09-4772-b1e4-c75b3971f7a5 => generated 1521 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:05:25.014406 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f66f7b64-450f-41e4-960d-02652adef416 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:25.015137 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f66f7b64-450f-41e4-960d-02652adef416 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:25.016164 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f66f7b64-450f-41e4-960d-02652adef416 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:25.016787 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f66f7b64-450f-41e4-960d-02652adef416 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:25.060496 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-6dfd5948-7434-4a1d-a2a9-600995ae0306 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:25.061755 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-6dfd5948-7434-4a1d-a2a9-600995ae0306 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:25.078615 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-6dfd5948-7434-4a1d-a2a9-600995ae0306 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:25.079079 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-6dfd5948-7434-4a1d-a2a9-600995ae0306 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:25.079903 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-6dfd5948-7434-4a1d-a2a9-600995ae0306 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:25.080523 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-6dfd5948-7434-4a1d-a2a9-600995ae0306 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:25.291114 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-6dfd5948-7434-4a1d-a2a9-600995ae0306 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:25.305618 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-6dfd5948-7434-4a1d-a2a9-600995ae0306 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:25.308121 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-6dfd5948-7434-4a1d-a2a9-600995ae0306 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:25.309459 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-6dfd5948-7434-4a1d-a2a9-600995ae0306 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1408 microversion: 2.20 time: 0.253119 Jun 07 22:05:25.310232 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 216/405] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:05:25 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1408 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:05:25.360170 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-f66f7b64-450f-41e4-960d-02652adef416 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce9ec4aea9449d3890f6dbb93f97968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc558dd3848d4d3d950d7cd408e19741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:25.371470 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-f66f7b64-450f-41e4-960d-02652adef416 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "GET /compute/v2.1/servers/12d312ce-b6a9-4f85-990c-772d64ee228f" status: 200 len: 1314 microversion: 2.1 time: 0.379008 Jun 07 22:05:25.373056 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 190/406] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:24 2022] GET /compute/v2.1/servers/12d312ce-b6a9-4f85-990c-772d64ee228f => generated 1314 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:05:26.024386 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-380ec2b5-8892-46e9-b511-2e55a4985ceb tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:26.026186 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-380ec2b5-8892-46e9-b511-2e55a4985ceb tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 92b3a56b-7d09-4772-b1e4-c75b3971f7a5] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:26.053169 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-380ec2b5-8892-46e9-b511-2e55a4985ceb tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:26.053869 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-380ec2b5-8892-46e9-b511-2e55a4985ceb tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:26.055028 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-380ec2b5-8892-46e9-b511-2e55a4985ceb tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:26.056075 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-380ec2b5-8892-46e9-b511-2e55a4985ceb tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:26.316612 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-380ec2b5-8892-46e9-b511-2e55a4985ceb tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:26.326610 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-55be4298-2915-4535-b633-106e1bea337c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:26.327222 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-55be4298-2915-4535-b633-106e1bea337c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:26.337168 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-380ec2b5-8892-46e9-b511-2e55a4985ceb tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/92b3a56b-7d09-4772-b1e4-c75b3971f7a5" status: 200 len: 1521 microversion: 2.1 time: 0.322227 Jun 07 22:05:26.341167 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-55be4298-2915-4535-b633-106e1bea337c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:26.341613 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-55be4298-2915-4535-b633-106e1bea337c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:26.342276 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 217/407] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:26 2022] GET /compute/v2.1/servers/92b3a56b-7d09-4772-b1e4-c75b3971f7a5 => generated 1521 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:05:26.342780 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-55be4298-2915-4535-b633-106e1bea337c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:26.343431 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-55be4298-2915-4535-b633-106e1bea337c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:26.400430 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-db655c9f-77f9-4724-a50e-32afcef44b5f tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:26.402090 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-db655c9f-77f9-4724-a50e-32afcef44b5f tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 12d312ce-b6a9-4f85-990c-772d64ee228f] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:26.410146 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-db655c9f-77f9-4724-a50e-32afcef44b5f tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:26.412746 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-db655c9f-77f9-4724-a50e-32afcef44b5f tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:26.413539 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-db655c9f-77f9-4724-a50e-32afcef44b5f tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:26.414013 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-db655c9f-77f9-4724-a50e-32afcef44b5f tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:26.523024 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-55be4298-2915-4535-b633-106e1bea337c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:26.533642 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-55be4298-2915-4535-b633-106e1bea337c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:26.535135 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-55be4298-2915-4535-b633-106e1bea337c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:26.536768 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-55be4298-2915-4535-b633-106e1bea337c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1408 microversion: 2.20 time: 0.214056 Jun 07 22:05:26.537313 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 191/408] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:05:26 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1408 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 22:05:26.628193 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-db655c9f-77f9-4724-a50e-32afcef44b5f tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce9ec4aea9449d3890f6dbb93f97968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc558dd3848d4d3d950d7cd408e19741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:26.636924 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-db655c9f-77f9-4724-a50e-32afcef44b5f tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "GET /compute/v2.1/servers/12d312ce-b6a9-4f85-990c-772d64ee228f" status: 200 len: 1314 microversion: 2.1 time: 0.250581 Jun 07 22:05:26.637837 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 218/409] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:26 2022] GET /compute/v2.1/servers/12d312ce-b6a9-4f85-990c-772d64ee228f => generated 1314 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:05:27.359084 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-82566332-6e95-4d80-a57e-81605b30a9a5 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:27.359880 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-82566332-6e95-4d80-a57e-81605b30a9a5 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 92b3a56b-7d09-4772-b1e4-c75b3971f7a5] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:27.367725 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-82566332-6e95-4d80-a57e-81605b30a9a5 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:27.368455 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-82566332-6e95-4d80-a57e-81605b30a9a5 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:27.369342 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-82566332-6e95-4d80-a57e-81605b30a9a5 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:27.370053 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-82566332-6e95-4d80-a57e-81605b30a9a5 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:27.385506 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:05:27.513851 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-82566332-6e95-4d80-a57e-81605b30a9a5 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:27.521438 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-82566332-6e95-4d80-a57e-81605b30a9a5 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/92b3a56b-7d09-4772-b1e4-c75b3971f7a5" status: 200 len: 1521 microversion: 2.1 time: 0.166498 Jun 07 22:05:27.531939 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 192/410] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:27 2022] GET /compute/v2.1/servers/92b3a56b-7d09-4772-b1e4-c75b3971f7a5 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:05:27.558037 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-2d7e2539-71d8-4b80-8109-52ac68c37f14 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:27.559545 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-2d7e2539-71d8-4b80-8109-52ac68c37f14 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:27.567105 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-2d7e2539-71d8-4b80-8109-52ac68c37f14 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:27.567884 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-2d7e2539-71d8-4b80-8109-52ac68c37f14 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:27.568855 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-2d7e2539-71d8-4b80-8109-52ac68c37f14 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:27.569661 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-2d7e2539-71d8-4b80-8109-52ac68c37f14 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:27.658331 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-09b429da-04a1-4698-a16e-024a4c46ad03 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:27.659186 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-09b429da-04a1-4698-a16e-024a4c46ad03 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 12d312ce-b6a9-4f85-990c-772d64ee228f] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:27.667731 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-09b429da-04a1-4698-a16e-024a4c46ad03 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:27.668579 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-09b429da-04a1-4698-a16e-024a4c46ad03 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:27.669483 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-09b429da-04a1-4698-a16e-024a4c46ad03 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:27.670184 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-09b429da-04a1-4698-a16e-024a4c46ad03 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:27.826593 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-2d7e2539-71d8-4b80-8109-52ac68c37f14 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:27.829048 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-09b429da-04a1-4698-a16e-024a4c46ad03 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce9ec4aea9449d3890f6dbb93f97968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc558dd3848d4d3d950d7cd408e19741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:27.837666 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-09b429da-04a1-4698-a16e-024a4c46ad03 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "GET /compute/v2.1/servers/12d312ce-b6a9-4f85-990c-772d64ee228f" status: 200 len: 1314 microversion: 2.1 time: 0.183756 Jun 07 22:05:27.838255 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 193/411] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:27 2022] GET /compute/v2.1/servers/12d312ce-b6a9-4f85-990c-772d64ee228f => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:05:27.844510 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-2d7e2539-71d8-4b80-8109-52ac68c37f14 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:27.846923 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-2d7e2539-71d8-4b80-8109-52ac68c37f14 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:27.848652 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-2d7e2539-71d8-4b80-8109-52ac68c37f14 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1408 microversion: 2.20 time: 0.298413 Jun 07 22:05:27.849456 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 219/412] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:05:27 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1408 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:05:28.539883 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-3594b274-e894-4547-bf21-3c50933e70e6 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:28.540496 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-3594b274-e894-4547-bf21-3c50933e70e6 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 92b3a56b-7d09-4772-b1e4-c75b3971f7a5] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:28.549406 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-3594b274-e894-4547-bf21-3c50933e70e6 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:28.550258 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-3594b274-e894-4547-bf21-3c50933e70e6 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:28.551201 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-3594b274-e894-4547-bf21-3c50933e70e6 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:28.551784 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-3594b274-e894-4547-bf21-3c50933e70e6 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:28.747499 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-3594b274-e894-4547-bf21-3c50933e70e6 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:28.758432 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-3594b274-e894-4547-bf21-3c50933e70e6 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/92b3a56b-7d09-4772-b1e4-c75b3971f7a5" status: 200 len: 1521 microversion: 2.1 time: 0.222167 Jun 07 22:05:28.759914 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 194/413] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:28 2022] GET /compute/v2.1/servers/92b3a56b-7d09-4772-b1e4-c75b3971f7a5 => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:05:28.854504 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-78d97bf9-147e-415f-8c66-ee2a5a18b3bb tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:28.855110 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-78d97bf9-147e-415f-8c66-ee2a5a18b3bb tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 12d312ce-b6a9-4f85-990c-772d64ee228f] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:28.866744 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-6a03a690-a887-4938-b0de-31b9feba4444 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:28.867502 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-6a03a690-a887-4938-b0de-31b9feba4444 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:28.871704 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-78d97bf9-147e-415f-8c66-ee2a5a18b3bb tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:28.872263 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-78d97bf9-147e-415f-8c66-ee2a5a18b3bb tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:28.873249 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-78d97bf9-147e-415f-8c66-ee2a5a18b3bb tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:28.873835 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-78d97bf9-147e-415f-8c66-ee2a5a18b3bb tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:28.874116 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6a03a690-a887-4938-b0de-31b9feba4444 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:28.874662 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6a03a690-a887-4938-b0de-31b9feba4444 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:28.875524 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6a03a690-a887-4938-b0de-31b9feba4444 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:28.876174 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6a03a690-a887-4938-b0de-31b9feba4444 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:29.341611 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-6a03a690-a887-4938-b0de-31b9feba4444 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:29.350926 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-6a03a690-a887-4938-b0de-31b9feba4444 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:29.353695 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-6a03a690-a887-4938-b0de-31b9feba4444 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:29.355089 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-6a03a690-a887-4938-b0de-31b9feba4444 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1408 microversion: 2.20 time: 0.492190 Jun 07 22:05:29.355792 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 195/414] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:05:28 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1408 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 22:05:29.373679 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-78d97bf9-147e-415f-8c66-ee2a5a18b3bb tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce9ec4aea9449d3890f6dbb93f97968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc558dd3848d4d3d950d7cd408e19741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:29.382317 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-78d97bf9-147e-415f-8c66-ee2a5a18b3bb tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "GET /compute/v2.1/servers/12d312ce-b6a9-4f85-990c-772d64ee228f" status: 200 len: 1314 microversion: 2.1 time: 0.532177 Jun 07 22:05:29.383902 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 220/415] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:28 2022] GET /compute/v2.1/servers/12d312ce-b6a9-4f85-990c-772d64ee228f => generated 1314 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:05:29.776061 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-e4f1bdaa-c933-4fef-a7ab-63c987be76df tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:29.777667 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-e4f1bdaa-c933-4fef-a7ab-63c987be76df tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 92b3a56b-7d09-4772-b1e4-c75b3971f7a5] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:29.793479 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e4f1bdaa-c933-4fef-a7ab-63c987be76df tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:29.793924 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e4f1bdaa-c933-4fef-a7ab-63c987be76df tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:29.794861 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e4f1bdaa-c933-4fef-a7ab-63c987be76df tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:29.795852 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e4f1bdaa-c933-4fef-a7ab-63c987be76df tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:30.230940 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-e4f1bdaa-c933-4fef-a7ab-63c987be76df tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:30.245812 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-e4f1bdaa-c933-4fef-a7ab-63c987be76df tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/92b3a56b-7d09-4772-b1e4-c75b3971f7a5" status: 200 len: 1521 microversion: 2.1 time: 0.473478 Jun 07 22:05:30.246319 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 196/416] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:29 2022] GET /compute/v2.1/servers/92b3a56b-7d09-4772-b1e4-c75b3971f7a5 => generated 1521 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:05:30.378155 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-d0220fb3-e279-478f-a5ed-10ed455e1739 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:30.378984 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-d0220fb3-e279-478f-a5ed-10ed455e1739 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:30.386559 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-d0220fb3-e279-478f-a5ed-10ed455e1739 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:30.387015 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-d0220fb3-e279-478f-a5ed-10ed455e1739 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:30.387826 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-d0220fb3-e279-478f-a5ed-10ed455e1739 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:30.388263 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-d0220fb3-e279-478f-a5ed-10ed455e1739 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:30.400387 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-39fed509-a957-4bda-bde1-0db446ec66ed tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:30.400990 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-39fed509-a957-4bda-bde1-0db446ec66ed tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 12d312ce-b6a9-4f85-990c-772d64ee228f] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:30.419765 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-39fed509-a957-4bda-bde1-0db446ec66ed tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:30.420527 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-39fed509-a957-4bda-bde1-0db446ec66ed tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:30.421348 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-39fed509-a957-4bda-bde1-0db446ec66ed tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:30.421783 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-39fed509-a957-4bda-bde1-0db446ec66ed tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:30.656323 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-d0220fb3-e279-478f-a5ed-10ed455e1739 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:30.666008 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-d0220fb3-e279-478f-a5ed-10ed455e1739 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:30.669154 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-d0220fb3-e279-478f-a5ed-10ed455e1739 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:30.670308 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-d0220fb3-e279-478f-a5ed-10ed455e1739 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1408 microversion: 2.20 time: 0.298034 Jun 07 22:05:30.691004 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 221/417] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:05:30 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1408 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:05:30.852156 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-39fed509-a957-4bda-bde1-0db446ec66ed tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce9ec4aea9449d3890f6dbb93f97968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc558dd3848d4d3d950d7cd408e19741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:30.862999 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-39fed509-a957-4bda-bde1-0db446ec66ed tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "GET /compute/v2.1/servers/12d312ce-b6a9-4f85-990c-772d64ee228f" status: 200 len: 1314 microversion: 2.1 time: 0.466681 Jun 07 22:05:30.875096 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 197/418] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:30 2022] GET /compute/v2.1/servers/12d312ce-b6a9-4f85-990c-772d64ee228f => generated 1314 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:05:31.262691 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-9888c18f-6510-4e47-80f0-1c309f5d7003 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:31.263793 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-9888c18f-6510-4e47-80f0-1c309f5d7003 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 92b3a56b-7d09-4772-b1e4-c75b3971f7a5] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:31.275650 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-9888c18f-6510-4e47-80f0-1c309f5d7003 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:31.276236 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-9888c18f-6510-4e47-80f0-1c309f5d7003 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:31.277149 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-9888c18f-6510-4e47-80f0-1c309f5d7003 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:31.279927 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-9888c18f-6510-4e47-80f0-1c309f5d7003 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:31.528399 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-9888c18f-6510-4e47-80f0-1c309f5d7003 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:31.537634 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-9888c18f-6510-4e47-80f0-1c309f5d7003 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/92b3a56b-7d09-4772-b1e4-c75b3971f7a5" status: 200 len: 1521 microversion: 2.1 time: 0.279005 Jun 07 22:05:31.538226 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 222/419] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:31 2022] GET /compute/v2.1/servers/92b3a56b-7d09-4772-b1e4-c75b3971f7a5 => generated 1521 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:05:31.698518 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-43d66a0c-6fa7-4455-acf6-583bdb03e7bd tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:31.699135 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-43d66a0c-6fa7-4455-acf6-583bdb03e7bd tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:31.708876 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-43d66a0c-6fa7-4455-acf6-583bdb03e7bd tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:31.709578 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-43d66a0c-6fa7-4455-acf6-583bdb03e7bd tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:31.711435 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-43d66a0c-6fa7-4455-acf6-583bdb03e7bd tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:31.712075 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-43d66a0c-6fa7-4455-acf6-583bdb03e7bd tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:31.883536 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-a1306c58-d27c-4ea2-968f-726f435a6003 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:31.884153 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-a1306c58-d27c-4ea2-968f-726f435a6003 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 12d312ce-b6a9-4f85-990c-772d64ee228f] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:31.892547 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a1306c58-d27c-4ea2-968f-726f435a6003 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:31.893003 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a1306c58-d27c-4ea2-968f-726f435a6003 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:31.893779 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a1306c58-d27c-4ea2-968f-726f435a6003 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:31.894216 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a1306c58-d27c-4ea2-968f-726f435a6003 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:31.929328 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_cell1:SELECT=100 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:05:32.130207 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-a1306c58-d27c-4ea2-968f-726f435a6003 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce9ec4aea9449d3890f6dbb93f97968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc558dd3848d4d3d950d7cd408e19741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:32.139125 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-a1306c58-d27c-4ea2-968f-726f435a6003 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "GET /compute/v2.1/servers/12d312ce-b6a9-4f85-990c-772d64ee228f" status: 200 len: 1314 microversion: 2.1 time: 0.260312 Jun 07 22:05:32.140962 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 223/420] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:31 2022] GET /compute/v2.1/servers/12d312ce-b6a9-4f85-990c-772d64ee228f => generated 1314 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:05:32.153792 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-43d66a0c-6fa7-4455-acf6-583bdb03e7bd tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:32.163865 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-43d66a0c-6fa7-4455-acf6-583bdb03e7bd tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:32.166797 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-43d66a0c-6fa7-4455-acf6-583bdb03e7bd tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:32.168230 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-43d66a0c-6fa7-4455-acf6-583bdb03e7bd tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1408 microversion: 2.20 time: 0.474606 Jun 07 22:05:32.178961 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 198/421] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:05:31 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1408 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:05:32.555724 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-f5bf6a6c-40f7-4ef1-9778-c3d807de8409 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:32.556429 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-f5bf6a6c-40f7-4ef1-9778-c3d807de8409 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 92b3a56b-7d09-4772-b1e4-c75b3971f7a5] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:32.568535 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-f5bf6a6c-40f7-4ef1-9778-c3d807de8409 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:32.572643 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-f5bf6a6c-40f7-4ef1-9778-c3d807de8409 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:32.573672 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-f5bf6a6c-40f7-4ef1-9778-c3d807de8409 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:32.574519 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-f5bf6a6c-40f7-4ef1-9778-c3d807de8409 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:32.753877 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-f5bf6a6c-40f7-4ef1-9778-c3d807de8409 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:32.765272 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-f5bf6a6c-40f7-4ef1-9778-c3d807de8409 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/92b3a56b-7d09-4772-b1e4-c75b3971f7a5" status: 200 len: 1521 microversion: 2.1 time: 0.214741 Jun 07 22:05:32.765852 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 224/422] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:32 2022] GET /compute/v2.1/servers/92b3a56b-7d09-4772-b1e4-c75b3971f7a5 => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:05:33.157789 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-8bda999d-59fd-404f-b3c7-083b49ca0355 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:33.158377 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-8bda999d-59fd-404f-b3c7-083b49ca0355 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 12d312ce-b6a9-4f85-990c-772d64ee228f] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:33.164809 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-8bda999d-59fd-404f-b3c7-083b49ca0355 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:33.165458 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-8bda999d-59fd-404f-b3c7-083b49ca0355 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:33.166213 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-8bda999d-59fd-404f-b3c7-083b49ca0355 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:33.166638 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-8bda999d-59fd-404f-b3c7-083b49ca0355 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:33.186955 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-a37c1e0d-1a5e-47db-a74d-4f131f9fd689 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:33.187593 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-a37c1e0d-1a5e-47db-a74d-4f131f9fd689 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:33.193944 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a37c1e0d-1a5e-47db-a74d-4f131f9fd689 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:33.194595 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a37c1e0d-1a5e-47db-a74d-4f131f9fd689 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:33.195574 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a37c1e0d-1a5e-47db-a74d-4f131f9fd689 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:33.196179 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a37c1e0d-1a5e-47db-a74d-4f131f9fd689 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:33.335231 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-8bda999d-59fd-404f-b3c7-083b49ca0355 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce9ec4aea9449d3890f6dbb93f97968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc558dd3848d4d3d950d7cd408e19741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:33.344657 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-8bda999d-59fd-404f-b3c7-083b49ca0355 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "GET /compute/v2.1/servers/12d312ce-b6a9-4f85-990c-772d64ee228f" status: 200 len: 1314 microversion: 2.1 time: 0.190552 Jun 07 22:05:33.354853 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 199/423] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:33 2022] GET /compute/v2.1/servers/12d312ce-b6a9-4f85-990c-772d64ee228f => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:05:33.414842 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-a37c1e0d-1a5e-47db-a74d-4f131f9fd689 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:33.424347 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-a37c1e0d-1a5e-47db-a74d-4f131f9fd689 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:33.427116 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-a37c1e0d-1a5e-47db-a74d-4f131f9fd689 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:33.428944 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-a37c1e0d-1a5e-47db-a74d-4f131f9fd689 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1600 microversion: 2.20 time: 0.246325 Jun 07 22:05:33.432189 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 225/424] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:05:33 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1600 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 22:05:33.449104 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [req-6b69426d-42cb-45dc-b31d-c9babb7f4e73 req-9bb99604-0b0b-419e-a3b3-c35f1944316b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12d312ce-b6a9-4f85-990c-772d64ee228f", "name": "network-vif-plugged", "status": "completed", "tag": "38b9b5c5-93c7-4f09-b333-b20420e7f7ab"}]} {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:05:33.455550 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-5544a81f-b4e5-4107-b594-2830871ab941 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:33.456042 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-5544a81f-b4e5-4107-b594-2830871ab941 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:33.463135 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-5544a81f-b4e5-4107-b594-2830871ab941 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:33.463665 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-5544a81f-b4e5-4107-b594-2830871ab941 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:33.464436 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-5544a81f-b4e5-4107-b594-2830871ab941 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:33.464871 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-5544a81f-b4e5-4107-b594-2830871ab941 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:33.465154 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [req-6b69426d-42cb-45dc-b31d-c9babb7f4e73 req-9bb99604-0b0b-419e-a3b3-c35f1944316b service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:33.465622 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [req-6b69426d-42cb-45dc-b31d-c9babb7f4e73 req-9bb99604-0b0b-419e-a3b3-c35f1944316b service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:33.495355 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.compute.server_external_events [req-6b69426d-42cb-45dc-b31d-c9babb7f4e73 req-9bb99604-0b0b-419e-a3b3-c35f1944316b service nova] Creating event network-vif-plugged:38b9b5c5-93c7-4f09-b333-b20420e7f7ab for instance 12d312ce-b6a9-4f85-990c-772d64ee228f on hv-cinder-83552 Jun 07 22:05:33.506340 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [req-6b69426d-42cb-45dc-b31d-c9babb7f4e73 req-9bb99604-0b0b-419e-a3b3-c35f1944316b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063154 Jun 07 22:05:33.509853 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 200/425] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:05:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:05:33.567047 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-5544a81f-b4e5-4107-b594-2830871ab941 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.122429 Jun 07 22:05:33.575393 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 226/426] 10.222.0.13 () {60 vars in 1315 bytes} [Tue Jun 7 22:05:33 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95/os-interface => generated 284 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 22:05:33.782342 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-d9d7d1c6-678f-4e50-ba94-8bf8885a640c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:33.783026 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-d9d7d1c6-678f-4e50-ba94-8bf8885a640c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 92b3a56b-7d09-4772-b1e4-c75b3971f7a5] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:33.791192 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d9d7d1c6-678f-4e50-ba94-8bf8885a640c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:33.791192 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d9d7d1c6-678f-4e50-ba94-8bf8885a640c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:33.791617 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d9d7d1c6-678f-4e50-ba94-8bf8885a640c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:33.792254 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d9d7d1c6-678f-4e50-ba94-8bf8885a640c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:34.061591 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-d9d7d1c6-678f-4e50-ba94-8bf8885a640c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:34.069148 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-d9d7d1c6-678f-4e50-ba94-8bf8885a640c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/92b3a56b-7d09-4772-b1e4-c75b3971f7a5" status: 200 len: 1521 microversion: 2.1 time: 0.290809 Jun 07 22:05:34.070472 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 201/427] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:33 2022] GET /compute/v2.1/servers/92b3a56b-7d09-4772-b1e4-c75b3971f7a5 => generated 1521 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:05:34.375594 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-88710d80-41ec-4511-ad66-5b267d577be9 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:34.377033 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-88710d80-41ec-4511-ad66-5b267d577be9 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 12d312ce-b6a9-4f85-990c-772d64ee228f] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:34.390314 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-88710d80-41ec-4511-ad66-5b267d577be9 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:34.391213 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-88710d80-41ec-4511-ad66-5b267d577be9 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:34.393950 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-88710d80-41ec-4511-ad66-5b267d577be9 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:34.396263 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-88710d80-41ec-4511-ad66-5b267d577be9 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:34.601552 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-88710d80-41ec-4511-ad66-5b267d577be9 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce9ec4aea9449d3890f6dbb93f97968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc558dd3848d4d3d950d7cd408e19741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:34.624051 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-88710d80-41ec-4511-ad66-5b267d577be9 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "GET /compute/v2.1/servers/12d312ce-b6a9-4f85-990c-772d64ee228f" status: 200 len: 1314 microversion: 2.1 time: 0.244090 Jun 07 22:05:34.640181 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 227/428] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:34 2022] GET /compute/v2.1/servers/12d312ce-b6a9-4f85-990c-772d64ee228f => generated 1314 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:05:35.015959 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [req-3e0159e6-dafd-4832-9deb-773168cd87f9 req-31fdc6f0-d1e0-449d-80d3-a3af95081336 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07abb105-095a-47ad-8761-b5075254ac95", "tag": "dfed4201-3c81-4b15-b164-8dd355eaca62"}]} {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:05:35.025480 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [req-3e0159e6-dafd-4832-9deb-773168cd87f9 req-31fdc6f0-d1e0-449d-80d3-a3af95081336 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:35.026154 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [req-3e0159e6-dafd-4832-9deb-773168cd87f9 req-31fdc6f0-d1e0-449d-80d3-a3af95081336 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:35.038167 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.compute.server_external_events [req-3e0159e6-dafd-4832-9deb-773168cd87f9 req-31fdc6f0-d1e0-449d-80d3-a3af95081336 service nova] Creating event network-changed:dfed4201-3c81-4b15-b164-8dd355eaca62 for instance 07abb105-095a-47ad-8761-b5075254ac95 on hv-cinder-83552 Jun 07 22:05:35.044842 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [req-3e0159e6-dafd-4832-9deb-773168cd87f9 req-31fdc6f0-d1e0-449d-80d3-a3af95081336 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031806 Jun 07 22:05:35.045666 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 202/429] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:05:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:05:35.088051 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-19e469c8-0bb9-41c9-b408-fb3ee7038646 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:35.088793 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-19e469c8-0bb9-41c9-b408-fb3ee7038646 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 92b3a56b-7d09-4772-b1e4-c75b3971f7a5] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:35.102791 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-19e469c8-0bb9-41c9-b408-fb3ee7038646 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:35.103242 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-19e469c8-0bb9-41c9-b408-fb3ee7038646 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:35.111801 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-19e469c8-0bb9-41c9-b408-fb3ee7038646 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:35.112254 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-19e469c8-0bb9-41c9-b408-fb3ee7038646 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:35.509136 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-19e469c8-0bb9-41c9-b408-fb3ee7038646 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:35.533540 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-19e469c8-0bb9-41c9-b408-fb3ee7038646 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/92b3a56b-7d09-4772-b1e4-c75b3971f7a5" status: 200 len: 1521 microversion: 2.1 time: 0.451340 Jun 07 22:05:35.539923 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 228/430] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:35 2022] GET /compute/v2.1/servers/92b3a56b-7d09-4772-b1e4-c75b3971f7a5 => generated 1521 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:05:35.647594 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-6abb0a95-d92d-4d80-ba40-628d79072162 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:35.648931 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-6abb0a95-d92d-4d80-ba40-628d79072162 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 12d312ce-b6a9-4f85-990c-772d64ee228f] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:35.661916 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6abb0a95-d92d-4d80-ba40-628d79072162 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:35.662363 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6abb0a95-d92d-4d80-ba40-628d79072162 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:35.663150 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6abb0a95-d92d-4d80-ba40-628d79072162 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:35.663682 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6abb0a95-d92d-4d80-ba40-628d79072162 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:36.292352 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-6abb0a95-d92d-4d80-ba40-628d79072162 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce9ec4aea9449d3890f6dbb93f97968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc558dd3848d4d3d950d7cd408e19741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:36.313597 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-6abb0a95-d92d-4d80-ba40-628d79072162 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "GET /compute/v2.1/servers/12d312ce-b6a9-4f85-990c-772d64ee228f" status: 200 len: 1314 microversion: 2.1 time: 0.672120 Jun 07 22:05:36.318530 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 203/431] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:35 2022] GET /compute/v2.1/servers/12d312ce-b6a9-4f85-990c-772d64ee228f => generated 1314 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:05:36.395971 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-05df026d-cb43-4268-8dc8-cae579e46a9f tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ed129da9-f353-4d84-84fb-e36bd8ae0a3e", "device": "/dev/sdb"}} {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:05:36.397890 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-05df026d-cb43-4268-8dc8-cae579e46a9f tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] [instance: 8f7f3be8-21d5-446e-9ee5-0caa7c97a68a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:36.419875 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-05df026d-cb43-4268-8dc8-cae579e46a9f tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:36.420334 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-05df026d-cb43-4268-8dc8-cae579e46a9f tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:36.421131 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-05df026d-cb43-4268-8dc8-cae579e46a9f tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:36.421568 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-05df026d-cb43-4268-8dc8-cae579e46a9f tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:36.560017 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-67e03c6d-b1cd-4fd2-9943-0baa217913c2 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:36.564058 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-67e03c6d-b1cd-4fd2-9943-0baa217913c2 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 92b3a56b-7d09-4772-b1e4-c75b3971f7a5] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:36.581191 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-67e03c6d-b1cd-4fd2-9943-0baa217913c2 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:36.581649 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-67e03c6d-b1cd-4fd2-9943-0baa217913c2 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:36.582421 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-67e03c6d-b1cd-4fd2-9943-0baa217913c2 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:36.582856 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-67e03c6d-b1cd-4fd2-9943-0baa217913c2 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:37.016018 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-05df026d-cb43-4268-8dc8-cae579e46a9f tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] 10.222.0.13 "POST /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.626495 Jun 07 22:05:37.017198 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 229/432] 10.222.0.13 () {60 vars in 1322 bytes} [Tue Jun 7 22:05:36 2022] POST /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a/os-volume_attachments => generated 194 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:05:37.093798 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-67e03c6d-b1cd-4fd2-9943-0baa217913c2 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:37.109572 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-67e03c6d-b1cd-4fd2-9943-0baa217913c2 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/92b3a56b-7d09-4772-b1e4-c75b3971f7a5" status: 200 len: 1521 microversion: 2.1 time: 0.554668 Jun 07 22:05:37.110850 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 204/433] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:36 2022] GET /compute/v2.1/servers/92b3a56b-7d09-4772-b1e4-c75b3971f7a5 => generated 1521 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:05:37.336651 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-fefdd28f-7e6c-4844-a1b5-90bc85300c61 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:37.337618 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-fefdd28f-7e6c-4844-a1b5-90bc85300c61 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 12d312ce-b6a9-4f85-990c-772d64ee228f] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:37.350578 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-fefdd28f-7e6c-4844-a1b5-90bc85300c61 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:37.352730 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-fefdd28f-7e6c-4844-a1b5-90bc85300c61 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:37.353545 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-fefdd28f-7e6c-4844-a1b5-90bc85300c61 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:37.356393 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-fefdd28f-7e6c-4844-a1b5-90bc85300c61 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:37.555123 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-fefdd28f-7e6c-4844-a1b5-90bc85300c61 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce9ec4aea9449d3890f6dbb93f97968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc558dd3848d4d3d950d7cd408e19741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:37.568710 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-fefdd28f-7e6c-4844-a1b5-90bc85300c61 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "GET /compute/v2.1/servers/12d312ce-b6a9-4f85-990c-772d64ee228f" status: 200 len: 1498 microversion: 2.1 time: 0.237996 Jun 07 22:05:37.569912 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 230/434] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:37 2022] GET /compute/v2.1/servers/12d312ce-b6a9-4f85-990c-772d64ee228f => generated 1498 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:05:38.136422 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-d002f711-c2c3-4ecb-9844-89201814ddb3 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:38.137112 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-d002f711-c2c3-4ecb-9844-89201814ddb3 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 92b3a56b-7d09-4772-b1e4-c75b3971f7a5] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:38.157341 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d002f711-c2c3-4ecb-9844-89201814ddb3 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:38.161622 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d002f711-c2c3-4ecb-9844-89201814ddb3 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:38.163070 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d002f711-c2c3-4ecb-9844-89201814ddb3 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:38.164304 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d002f711-c2c3-4ecb-9844-89201814ddb3 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:38.247705 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-c02ea97f-a77a-492c-ab8b-68e30484a61c tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:38.248305 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-c02ea97f-a77a-492c-ab8b-68e30484a61c tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 12d312ce-b6a9-4f85-990c-772d64ee228f] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:38.276667 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c02ea97f-a77a-492c-ab8b-68e30484a61c tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:38.277901 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c02ea97f-a77a-492c-ab8b-68e30484a61c tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:38.279245 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c02ea97f-a77a-492c-ab8b-68e30484a61c tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:38.280331 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c02ea97f-a77a-492c-ab8b-68e30484a61c tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:38.323160 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-c02ea97f-a77a-492c-ab8b-68e30484a61c tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 12d312ce-b6a9-4f85-990c-772d64ee228f] Going to try to terminate instance {{(pid=117971) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 22:05:38.482963 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-d002f711-c2c3-4ecb-9844-89201814ddb3 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:38.487797 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-c02ea97f-a77a-492c-ab8b-68e30484a61c tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "DELETE /compute/v2.1/servers/12d312ce-b6a9-4f85-990c-772d64ee228f" status: 204 len: 0 microversion: 2.1 time: 0.245732 Jun 07 22:05:38.491693 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 231/435] 10.222.0.13 () {58 vars in 1238 bytes} [Tue Jun 7 22:05:38 2022] DELETE /compute/v2.1/servers/12d312ce-b6a9-4f85-990c-772d64ee228f => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 07 22:05:38.500114 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-d002f711-c2c3-4ecb-9844-89201814ddb3 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/92b3a56b-7d09-4772-b1e4-c75b3971f7a5" status: 200 len: 1521 microversion: 2.1 time: 0.377102 Jun 07 22:05:38.501035 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 205/436] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:38 2022] GET /compute/v2.1/servers/92b3a56b-7d09-4772-b1e4-c75b3971f7a5 => generated 1521 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:05:38.501453 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-48ddb414-2172-48f9-8636-4c6243a402bb tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:38.506427 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-48ddb414-2172-48f9-8636-4c6243a402bb tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 12d312ce-b6a9-4f85-990c-772d64ee228f] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:38.521419 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-48ddb414-2172-48f9-8636-4c6243a402bb tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:38.524332 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-48ddb414-2172-48f9-8636-4c6243a402bb tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:38.525304 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-48ddb414-2172-48f9-8636-4c6243a402bb tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:38.526070 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-48ddb414-2172-48f9-8636-4c6243a402bb tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:38.771708 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-48ddb414-2172-48f9-8636-4c6243a402bb tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce9ec4aea9449d3890f6dbb93f97968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc558dd3848d4d3d950d7cd408e19741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:38.785661 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-48ddb414-2172-48f9-8636-4c6243a402bb tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "GET /compute/v2.1/servers/12d312ce-b6a9-4f85-990c-772d64ee228f" status: 200 len: 1504 microversion: 2.1 time: 0.290657 Jun 07 22:05:38.786088 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 232/437] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:38 2022] GET /compute/v2.1/servers/12d312ce-b6a9-4f85-990c-772d64ee228f => generated 1504 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:05:39.518954 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-a72070bf-c9ed-400c-83df-2a4ecb15b715 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:39.520229 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-a72070bf-c9ed-400c-83df-2a4ecb15b715 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 92b3a56b-7d09-4772-b1e4-c75b3971f7a5] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:39.527873 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a72070bf-c9ed-400c-83df-2a4ecb15b715 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:39.532836 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a72070bf-c9ed-400c-83df-2a4ecb15b715 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:39.537232 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a72070bf-c9ed-400c-83df-2a4ecb15b715 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:39.537920 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a72070bf-c9ed-400c-83df-2a4ecb15b715 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:39.754071 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-a72070bf-c9ed-400c-83df-2a4ecb15b715 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:39.766299 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-a72070bf-c9ed-400c-83df-2a4ecb15b715 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/92b3a56b-7d09-4772-b1e4-c75b3971f7a5" status: 200 len: 1521 microversion: 2.1 time: 0.251323 Jun 07 22:05:39.777692 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 206/438] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:39 2022] GET /compute/v2.1/servers/92b3a56b-7d09-4772-b1e4-c75b3971f7a5 => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:05:39.817988 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-e5da3cd9-fe38-431b-ab04-a2fa22265d17 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:39.818598 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-e5da3cd9-fe38-431b-ab04-a2fa22265d17 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 12d312ce-b6a9-4f85-990c-772d64ee228f] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:39.830828 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e5da3cd9-fe38-431b-ab04-a2fa22265d17 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:39.831793 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e5da3cd9-fe38-431b-ab04-a2fa22265d17 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:39.832756 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e5da3cd9-fe38-431b-ab04-a2fa22265d17 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:39.833348 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e5da3cd9-fe38-431b-ab04-a2fa22265d17 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:40.000809 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-e5da3cd9-fe38-431b-ab04-a2fa22265d17 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce9ec4aea9449d3890f6dbb93f97968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc558dd3848d4d3d950d7cd408e19741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:40.013445 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-e5da3cd9-fe38-431b-ab04-a2fa22265d17 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "GET /compute/v2.1/servers/12d312ce-b6a9-4f85-990c-772d64ee228f" status: 200 len: 1504 microversion: 2.1 time: 0.199526 Jun 07 22:05:40.018117 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 233/439] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:39 2022] GET /compute/v2.1/servers/12d312ce-b6a9-4f85-990c-772d64ee228f => generated 1504 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:05:40.786490 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-ecb5e0bc-0717-4b72-9676-075b46f6a2c8 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:40.787311 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-ecb5e0bc-0717-4b72-9676-075b46f6a2c8 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 92b3a56b-7d09-4772-b1e4-c75b3971f7a5] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:40.801596 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-ecb5e0bc-0717-4b72-9676-075b46f6a2c8 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:40.802050 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-ecb5e0bc-0717-4b72-9676-075b46f6a2c8 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:40.806897 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-ecb5e0bc-0717-4b72-9676-075b46f6a2c8 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:40.810650 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-ecb5e0bc-0717-4b72-9676-075b46f6a2c8 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:41.029927 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-e2e58152-17f3-481b-a668-ee3928b271eb tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:41.030543 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-e2e58152-17f3-481b-a668-ee3928b271eb tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 12d312ce-b6a9-4f85-990c-772d64ee228f] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:41.039121 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e2e58152-17f3-481b-a668-ee3928b271eb tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:41.043903 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e2e58152-17f3-481b-a668-ee3928b271eb tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:41.045531 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e2e58152-17f3-481b-a668-ee3928b271eb tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:41.046133 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e2e58152-17f3-481b-a668-ee3928b271eb tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:41.127386 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-ecb5e0bc-0717-4b72-9676-075b46f6a2c8 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:41.144271 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-ecb5e0bc-0717-4b72-9676-075b46f6a2c8 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/92b3a56b-7d09-4772-b1e4-c75b3971f7a5" status: 200 len: 1521 microversion: 2.1 time: 0.363214 Jun 07 22:05:41.146381 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 207/440] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:40 2022] GET /compute/v2.1/servers/92b3a56b-7d09-4772-b1e4-c75b3971f7a5 => generated 1521 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:05:41.228739 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-e2e58152-17f3-481b-a668-ee3928b271eb tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce9ec4aea9449d3890f6dbb93f97968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc558dd3848d4d3d950d7cd408e19741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:41.240048 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-e2e58152-17f3-481b-a668-ee3928b271eb tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "GET /compute/v2.1/servers/12d312ce-b6a9-4f85-990c-772d64ee228f" status: 200 len: 1504 microversion: 2.1 time: 0.213875 Jun 07 22:05:41.242460 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 234/441] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:41 2022] GET /compute/v2.1/servers/12d312ce-b6a9-4f85-990c-772d64ee228f => generated 1504 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:05:42.165836 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-373f93e2-f24c-403c-814e-17db14a5cdf8 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:42.167205 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-373f93e2-f24c-403c-814e-17db14a5cdf8 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 92b3a56b-7d09-4772-b1e4-c75b3971f7a5] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:42.184395 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_api:SELECT=66 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:05:42.186412 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-373f93e2-f24c-403c-814e-17db14a5cdf8 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:42.189672 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-373f93e2-f24c-403c-814e-17db14a5cdf8 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:42.202590 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-373f93e2-f24c-403c-814e-17db14a5cdf8 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:42.203371 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-373f93e2-f24c-403c-814e-17db14a5cdf8 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:42.263686 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-125aee32-299d-420f-96fd-4c165e069f53 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:42.265048 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-125aee32-299d-420f-96fd-4c165e069f53 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 12d312ce-b6a9-4f85-990c-772d64ee228f] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:42.280154 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-125aee32-299d-420f-96fd-4c165e069f53 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:42.282349 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-125aee32-299d-420f-96fd-4c165e069f53 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:42.283515 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-125aee32-299d-420f-96fd-4c165e069f53 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:42.287182 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-125aee32-299d-420f-96fd-4c165e069f53 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:42.588533 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-125aee32-299d-420f-96fd-4c165e069f53 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce9ec4aea9449d3890f6dbb93f97968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc558dd3848d4d3d950d7cd408e19741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:42.599156 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-125aee32-299d-420f-96fd-4c165e069f53 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "GET /compute/v2.1/servers/12d312ce-b6a9-4f85-990c-772d64ee228f" status: 200 len: 1504 microversion: 2.1 time: 0.342596 Jun 07 22:05:42.607646 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 235/442] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:42 2022] GET /compute/v2.1/servers/12d312ce-b6a9-4f85-990c-772d64ee228f => generated 1504 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:05:42.759005 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-373f93e2-f24c-403c-814e-17db14a5cdf8 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:42.775489 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-373f93e2-f24c-403c-814e-17db14a5cdf8 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/92b3a56b-7d09-4772-b1e4-c75b3971f7a5" status: 200 len: 1521 microversion: 2.1 time: 0.617330 Jun 07 22:05:42.777303 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 208/443] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:42 2022] GET /compute/v2.1/servers/92b3a56b-7d09-4772-b1e4-c75b3971f7a5 => generated 1521 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:05:43.366431 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [req-eb2953fb-8d17-4369-b429-87c7358b39cf req-380d5b8e-1edc-46f7-8f01-0e0273afb5bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12d312ce-b6a9-4f85-990c-772d64ee228f", "name": "network-vif-deleted", "tag": "38b9b5c5-93c7-4f09-b333-b20420e7f7ab"}]} {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:05:43.384183 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-eb2953fb-8d17-4369-b429-87c7358b39cf req-380d5b8e-1edc-46f7-8f01-0e0273afb5bd service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:43.384635 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-eb2953fb-8d17-4369-b429-87c7358b39cf req-380d5b8e-1edc-46f7-8f01-0e0273afb5bd service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:43.429310 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.compute.server_external_events [req-eb2953fb-8d17-4369-b429-87c7358b39cf req-380d5b8e-1edc-46f7-8f01-0e0273afb5bd service nova] Creating event network-vif-deleted:38b9b5c5-93c7-4f09-b333-b20420e7f7ab for instance 12d312ce-b6a9-4f85-990c-772d64ee228f on hv-cinder-83552 Jun 07 22:05:43.439970 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [req-eb2953fb-8d17-4369-b429-87c7358b39cf req-380d5b8e-1edc-46f7-8f01-0e0273afb5bd service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077456 Jun 07 22:05:43.440854 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 236/444] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:05:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:05:43.623749 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-6dced504-4fd2-433a-96d1-678cfb858dd0 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:43.624373 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-6dced504-4fd2-433a-96d1-678cfb858dd0 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 12d312ce-b6a9-4f85-990c-772d64ee228f] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:43.631984 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6dced504-4fd2-433a-96d1-678cfb858dd0 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:43.632974 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6dced504-4fd2-433a-96d1-678cfb858dd0 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:43.633755 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6dced504-4fd2-433a-96d1-678cfb858dd0 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:43.634189 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6dced504-4fd2-433a-96d1-678cfb858dd0 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:43.686134 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6dced504-4fd2-433a-96d1-678cfb858dd0 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:43.686391 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6dced504-4fd2-433a-96d1-678cfb858dd0 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:43.686843 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.objects.instance [None req-6dced504-4fd2-433a-96d1-678cfb858dd0 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lazy-loading 'fault' on Instance uuid 12d312ce-b6a9-4f85-990c-772d64ee228f {{(pid=117970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 22:05:43.737022 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-6dced504-4fd2-433a-96d1-678cfb858dd0 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce9ec4aea9449d3890f6dbb93f97968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc558dd3848d4d3d950d7cd408e19741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:43.748197 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-6dced504-4fd2-433a-96d1-678cfb858dd0 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "GET /compute/v2.1/servers/12d312ce-b6a9-4f85-990c-772d64ee228f" status: 200 len: 1304 microversion: 2.1 time: 0.128230 Jun 07 22:05:43.749954 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 209/445] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:43 2022] GET /compute/v2.1/servers/12d312ce-b6a9-4f85-990c-772d64ee228f => generated 1304 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:05:43.793665 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-7203bf1c-3269-4dca-852e-c76e4615bcbe tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:43.794358 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-7203bf1c-3269-4dca-852e-c76e4615bcbe tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 92b3a56b-7d09-4772-b1e4-c75b3971f7a5] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:43.805541 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-7203bf1c-3269-4dca-852e-c76e4615bcbe tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:43.805997 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-7203bf1c-3269-4dca-852e-c76e4615bcbe tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:43.806773 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-7203bf1c-3269-4dca-852e-c76e4615bcbe tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:43.812762 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-7203bf1c-3269-4dca-852e-c76e4615bcbe tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:44.073081 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-7203bf1c-3269-4dca-852e-c76e4615bcbe tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:44.086599 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-7203bf1c-3269-4dca-852e-c76e4615bcbe tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/92b3a56b-7d09-4772-b1e4-c75b3971f7a5" status: 200 len: 1501 microversion: 2.1 time: 0.297091 Jun 07 22:05:44.098728 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 237/446] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:43 2022] GET /compute/v2.1/servers/92b3a56b-7d09-4772-b1e4-c75b3971f7a5 => generated 1501 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:05:44.104374 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-8d650e71-b362-47f3-899e-3d1ec138024e tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "58146a1b-7dcf-4ea0-af3c-236ed20ad7fa"}} {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:05:44.105805 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-8d650e71-b362-47f3-899e-3d1ec138024e tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 92b3a56b-7d09-4772-b1e4-c75b3971f7a5] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:44.118484 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-8d650e71-b362-47f3-899e-3d1ec138024e tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:44.119232 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-8d650e71-b362-47f3-899e-3d1ec138024e tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:44.120260 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-8d650e71-b362-47f3-899e-3d1ec138024e tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:44.120881 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-8d650e71-b362-47f3-899e-3d1ec138024e tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:44.138055 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_cell1:SELECT=100 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:05:44.201195 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.wsgi [None req-8d650e71-b362-47f3-899e-3d1ec138024e tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] HTTP exception thrown: Cannot 'attach_volume' instance 92b3a56b-7d09-4772-b1e4-c75b3971f7a5 while it is in vm_state rescued Jun 07 22:05:44.203770 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-8d650e71-b362-47f3-899e-3d1ec138024e tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Request method failure captured: Jun 07 22:05:44.203770 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: request: POST /compute/v2.1/servers/92b3a56b-7d09-4772-b1e4-c75b3971f7a5/os-volume_attachments HTTP/1.1 Jun 07 22:05:44.203770 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Accept: application/json Jun 07 22:05:44.203770 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Accept-Encoding: identity Jun 07 22:05:44.203770 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Connection: close Jun 07 22:05:44.203770 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Content-Length: 74 Jun 07 22:05:44.203770 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Content-Type: application/json Jun 07 22:05:44.203770 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Host: 10.222.0.13 Jun 07 22:05:44.203770 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Openstack-System-Scope: None Jun 07 22:05:44.203770 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: User-Agent: python-urllib3/1.26.9 Jun 07 22:05:44.203770 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Auth-Token: gAAAAABin8sikwri0wz--bbwCQiRTo8aflsbVudHe_idy05qCCCm6kMV6CqJhWmtBn1AnbEoV22lfFfBtXzCrxKFJsUQou-LO31msxwdCukOro2yUZ7Ru7Jq7nfvAeg5tmJuzphYSRHzoedKYtMoC-7_d00L6jKIA57HYnc7FI-lfgXXUmmTM04 Jun 07 22:05:44.203770 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Domain-Id: None Jun 07 22:05:44.203770 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Domain-Name: None Jun 07 22:05:44.203770 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Identity-Status: Confirmed Jun 07 22:05:44.203770 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Is-Admin-Project: True Jun 07 22:05:44.203770 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Domain-Id: default Jun 07 22:05:44.203770 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Domain-Name: Default Jun 07 22:05:44.203770 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Id: 0a4fc48a5efe4d8b974757a5bf7d947e Jun 07 22:05:44.203770 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-676703940 Jun 07 22:05:44.203770 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Role: member,reader Jun 07 22:05:44.203770 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Roles: member,reader Jun 07 22:05:44.205087 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0a4fc48a5efe4d8b974757a5bf7d947e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_0a4fc48a5efe4d8b974757a5bf7d947e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0a4fc48a5efe4d8b974757a5bf7d947e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/0a4fc48a5efe4d8b974757a5bf7d947e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}] Jun 07 22:05:44.205087 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Tenant: tempest-ServerRescueNegativeTestJSON-676703940 Jun 07 22:05:44.205087 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Tenant-Id: 0a4fc48a5efe4d8b974757a5bf7d947e Jun 07 22:05:44.205087 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-676703940 Jun 07 22:05:44.205087 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User: tempest-ServerRescueNegativeTestJSON-676703940-project Jun 07 22:05:44.205087 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Domain-Id: default Jun 07 22:05:44.205087 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Domain-Name: Default Jun 07 22:05:44.205087 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Id: c44c1788959e4b339c9cd5aad4318496 Jun 07 22:05:44.205087 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Name: tempest-ServerRescueNegativeTestJSON-676703940-project Jun 07 22:05:44.205087 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Jun 07 22:05:44.205087 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: {"volumeAttachment": {"volumeId": "58146a1b-7dcf-4ea0-af3c-236ed20ad7fa"}} Jun 07 22:05:44.205087 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: method: > Jun 07 22:05:44.205881 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: exception: Cannot 'attach_volume' instance 92b3a56b-7d09-4772-b1e4-c75b3971f7a5 while it is in vm_state rescued Jun 07 22:05:44.205881 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: action_args: {'server_id': '92b3a56b-7d09-4772-b1e4-c75b3971f7a5', 'body': {'volumeAttachment': {'volumeId': '58146a1b-7dcf-4ea0-af3c-236ed20ad7fa'}}} Jun 07 22:05:44.205881 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 22:05:44.205881 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:05:44.205881 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 07 22:05:44.205881 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 07 22:05:44.205881 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 07 22:05:44.205881 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 07 22:05:44.205881 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 07 22:05:44.205881 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 07 22:05:44.205881 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 92b3a56b-7d09-4772-b1e4-c75b3971f7a5 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 07 22:05:44.205881 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:05:44.205881 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:05:44.205881 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:05:44.205881 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:05:44.205881 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:05:44.205881 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:05:44.205881 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 22:05:44.205881 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 22:05:44.207058 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 22:05:44.207058 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 22:05:44.207058 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 07 22:05:44.207058 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 22:05:44.207058 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 07 22:05:44.207058 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 22:05:44.207058 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 07 22:05:44.207058 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 22:05:44.207058 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 07 22:05:44.207058 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 07 22:05:44.207058 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 07 22:05:44.207058 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 07 22:05:44.207058 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 92b3a56b-7d09-4772-b1e4-c75b3971f7a5 while it is in vm_state rescued Jun 07 22:05:44.207058 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:05:44.207058 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:05:44.207058 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:05:44.207058 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:05:44.207058 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:05:44.207058 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:05:44.208183 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 22:05:44.208183 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 22:05:44.208183 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 92b3a56b-7d09-4772-b1e4-c75b3971f7a5 while it is in vm_state rescued Jun 07 22:05:44.208183 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:05:44.209921 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-8d650e71-b362-47f3-899e-3d1ec138024e tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Returning 409 to user: Cannot 'attach_volume' instance 92b3a56b-7d09-4772-b1e4-c75b3971f7a5 while it is in vm_state rescued {{(pid=117970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 22:05:44.220826 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-8d650e71-b362-47f3-899e-3d1ec138024e tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "POST /compute/v2.1/servers/92b3a56b-7d09-4772-b1e4-c75b3971f7a5/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.120901 Jun 07 22:05:44.222162 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 210/447] 10.222.0.13 () {60 vars in 1322 bytes} [Tue Jun 7 22:05:44 2022] POST /compute/v2.1/servers/92b3a56b-7d09-4772-b1e4-c75b3971f7a5/os-volume_attachments => generated 152 bytes in 123 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 07 22:05:44.231194 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-a0db03d9-4bb4-40f2-ae6c-9960226b4b94 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:05:44.231730 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-a0db03d9-4bb4-40f2-ae6c-9960226b4b94 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 92b3a56b-7d09-4772-b1e4-c75b3971f7a5] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:44.239796 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a0db03d9-4bb4-40f2-ae6c-9960226b4b94 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:44.243708 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a0db03d9-4bb4-40f2-ae6c-9960226b4b94 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:44.244738 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a0db03d9-4bb4-40f2-ae6c-9960226b4b94 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:44.246166 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a0db03d9-4bb4-40f2-ae6c-9960226b4b94 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:44.250955 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:05:44.362348 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-a0db03d9-4bb4-40f2-ae6c-9960226b4b94 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "POST /compute/v2.1/servers/92b3a56b-7d09-4772-b1e4-c75b3971f7a5/action" status: 202 len: 0 microversion: 2.1 time: 0.131421 Jun 07 22:05:44.364214 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 238/448] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Jun 7 22:05:44 2022] POST /compute/v2.1/servers/92b3a56b-7d09-4772-b1e4-c75b3971f7a5/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 22:05:44.379989 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-e7ef37c0-ea3d-46e7-ac46-ca540811221e tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:44.382190 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-e7ef37c0-ea3d-46e7-ac46-ca540811221e tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 92b3a56b-7d09-4772-b1e4-c75b3971f7a5] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:44.393885 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e7ef37c0-ea3d-46e7-ac46-ca540811221e tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:44.394673 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e7ef37c0-ea3d-46e7-ac46-ca540811221e tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:44.396154 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e7ef37c0-ea3d-46e7-ac46-ca540811221e tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:44.396798 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e7ef37c0-ea3d-46e7-ac46-ca540811221e tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:44.767136 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-51872841-2a48-4856-bab5-15e485fd3387 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:44.777387 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-51872841-2a48-4856-bab5-15e485fd3387 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 12d312ce-b6a9-4f85-990c-772d64ee228f] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:44.789653 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-51872841-2a48-4856-bab5-15e485fd3387 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:44.790350 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-51872841-2a48-4856-bab5-15e485fd3387 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:44.791136 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-51872841-2a48-4856-bab5-15e485fd3387 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:44.804686 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-51872841-2a48-4856-bab5-15e485fd3387 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:44.837464 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.wsgi [None req-51872841-2a48-4856-bab5-15e485fd3387 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] HTTP exception thrown: Instance 12d312ce-b6a9-4f85-990c-772d64ee228f could not be found. Jun 07 22:05:44.839133 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-51872841-2a48-4856-bab5-15e485fd3387 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Request method failure captured: Jun 07 22:05:44.839133 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: request: GET /compute/v2.1/servers/12d312ce-b6a9-4f85-990c-772d64ee228f HTTP/1.1 Jun 07 22:05:44.839133 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Accept: application/json Jun 07 22:05:44.839133 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Accept-Encoding: identity Jun 07 22:05:44.839133 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Connection: close Jun 07 22:05:44.839133 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Content-Length: 0 Jun 07 22:05:44.839133 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Content-Type: application/json Jun 07 22:05:44.839133 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Host: 10.222.0.13 Jun 07 22:05:44.839133 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Openstack-System-Scope: None Jun 07 22:05:44.839133 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: User-Agent: python-urllib3/1.26.9 Jun 07 22:05:44.839133 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Auth-Token: gAAAAABin8uPvbBELm6ICOqMntPlHJpYbyHCWbNguIUiqhAq-raDBg7IwLstCPKcLwtp2Hs4-CMvPcMfsGXtNRChedCOrBft4n3BdMnaV7iNd7Fb0IheiDuAQhKdmDHqDY3S__c3XZFMRfg2CUrmGkcZNFdbudWIggw5HjnefouR87I42sh_9cU Jun 07 22:05:44.839133 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Domain-Id: None Jun 07 22:05:44.839133 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Domain-Name: None Jun 07 22:05:44.839133 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Identity-Status: Confirmed Jun 07 22:05:44.839133 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Is-Admin-Project: True Jun 07 22:05:44.839133 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Domain-Id: default Jun 07 22:05:44.839133 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Domain-Name: Default Jun 07 22:05:44.839133 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Id: bc558dd3848d4d3d950d7cd408e19741 Jun 07 22:05:44.839133 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Name: tempest-VolumesActionsTest-1451820778 Jun 07 22:05:44.839133 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Role: member,reader Jun 07 22:05:44.839133 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Roles: member,reader Jun 07 22:05:44.840417 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/bc558dd3848d4d3d950d7cd408e19741"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_bc558dd3848d4d3d950d7cd408e19741"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/bc558dd3848d4d3d950d7cd408e19741"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/bc558dd3848d4d3d950d7cd408e19741"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}] Jun 07 22:05:44.840417 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant: tempest-VolumesActionsTest-1451820778 Jun 07 22:05:44.840417 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant-Id: bc558dd3848d4d3d950d7cd408e19741 Jun 07 22:05:44.840417 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant-Name: tempest-VolumesActionsTest-1451820778 Jun 07 22:05:44.840417 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User: tempest-VolumesActionsTest-1451820778-project Jun 07 22:05:44.840417 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Domain-Id: default Jun 07 22:05:44.840417 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Domain-Name: Default Jun 07 22:05:44.840417 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Id: 7ce9ec4aea9449d3890f6dbb93f97968 Jun 07 22:05:44.840417 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Name: tempest-VolumesActionsTest-1451820778-project Jun 07 22:05:44.840417 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: method: > Jun 07 22:05:44.840417 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: exception: Instance 12d312ce-b6a9-4f85-990c-772d64ee228f could not be found. Jun 07 22:05:44.840417 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: action_args: {'id': '12d312ce-b6a9-4f85-990c-772d64ee228f'} Jun 07 22:05:44.841159 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 22:05:44.841159 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:05:44.841159 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 22:05:44.841159 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 22:05:44.841159 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 22:05:44.841159 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 22:05:44.841159 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 22:05:44.841159 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 22:05:44.841159 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 22:05:44.841159 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 22:05:44.841159 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12d312ce-b6a9-4f85-990c-772d64ee228f could not be found. Jun 07 22:05:44.841159 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:05:44.841159 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:05:44.841159 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:05:44.841159 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:05:44.841159 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:05:44.841159 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:05:44.841159 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 22:05:44.841159 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 22:05:44.841159 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 22:05:44.842806 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 22:05:44.842806 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 22:05:44.842806 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 22:05:44.842806 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 22:05:44.842806 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 22:05:44.842806 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 22:05:44.842806 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 22:05:44.842806 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12d312ce-b6a9-4f85-990c-772d64ee228f could not be found. Jun 07 22:05:44.842806 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:05:44.842806 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:05:44.842806 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:05:44.842806 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:05:44.842806 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:05:44.842806 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:05:44.842806 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 22:05:44.842806 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 22:05:44.842806 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12d312ce-b6a9-4f85-990c-772d64ee228f could not be found. Jun 07 22:05:44.842806 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:05:44.844825 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-51872841-2a48-4856-bab5-15e485fd3387 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Returning 404 to user: Instance 12d312ce-b6a9-4f85-990c-772d64ee228f could not be found. {{(pid=117971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 22:05:44.844825 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-51872841-2a48-4856-bab5-15e485fd3387 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "GET /compute/v2.1/servers/12d312ce-b6a9-4f85-990c-772d64ee228f" status: 404 len: 111 microversion: 2.1 time: 0.078283 Jun 07 22:05:44.844825 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 239/449] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:44 2022] GET /compute/v2.1/servers/12d312ce-b6a9-4f85-990c-772d64ee228f => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 22:05:44.865253 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-e7ef37c0-ea3d-46e7-ac46-ca540811221e tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:44.883917 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-e7ef37c0-ea3d-46e7-ac46-ca540811221e tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/92b3a56b-7d09-4772-b1e4-c75b3971f7a5" status: 200 len: 1509 microversion: 2.1 time: 0.515262 Jun 07 22:05:44.884524 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 211/450] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:44 2022] GET /compute/v2.1/servers/92b3a56b-7d09-4772-b1e4-c75b3971f7a5 => generated 1509 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:05:45.001214 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-6aa13266-4d40-4d3e-b07f-e756103af6f6 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-187301318", "imageRef": "87e2e140-6de8-4531-9681-d0a3e069622d", "flavorRef": "452", "networks": [{"uuid": "5daa3807-4fcf-4a6c-9cd4-3f71c49f352b"}]}} {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:05:45.105155 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.network.neutron [None req-6aa13266-4d40-4d3e-b07f-e756103af6f6 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] validate_networks() for [('5daa3807-4fcf-4a6c-9cd4-3f71c49f352b', None, None, None, None, None)] {{(pid=117971) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 22:05:45.684375 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.virt.hardware [None req-6aa13266-4d40-4d3e-b07f-e756103af6f6 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Flavor limits 0:0:0 {{(pid=117971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 22:05:45.685389 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.virt.hardware [None req-6aa13266-4d40-4d3e-b07f-e756103af6f6 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Image limits 0:0:0 {{(pid=117971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 22:05:45.685875 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.virt.hardware [None req-6aa13266-4d40-4d3e-b07f-e756103af6f6 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Flavor pref 0:0:0 {{(pid=117971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 22:05:45.686290 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.virt.hardware [None req-6aa13266-4d40-4d3e-b07f-e756103af6f6 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Image pref 0:0:0 {{(pid=117971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 22:05:45.686699 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.virt.hardware [None req-6aa13266-4d40-4d3e-b07f-e756103af6f6 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 22:05:45.704488 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-6aa13266-4d40-4d3e-b07f-e756103af6f6 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:45.705339 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-6aa13266-4d40-4d3e-b07f-e756103af6f6 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:45.709034 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-6aa13266-4d40-4d3e-b07f-e756103af6f6 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:45.709853 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-6aa13266-4d40-4d3e-b07f-e756103af6f6 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:45.730870 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.quota [None req-6aa13266-4d40-4d3e-b07f-e756103af6f6 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Getting quotas for project bc558dd3848d4d3d950d7cd408e19741. Resources: {'cores', 'ram', 'instances'} {{(pid=117971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 22:05:45.736453 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.quota [None req-6aa13266-4d40-4d3e-b07f-e756103af6f6 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Getting quotas for user 7ce9ec4aea9449d3890f6dbb93f97968 and project bc558dd3848d4d3d950d7cd408e19741. Resources: {'cores', 'ram', 'instances'} {{(pid=117971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 22:05:45.784370 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-6aa13266-4d40-4d3e-b07f-e756103af6f6 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Going to run 1 instances... {{(pid=117971) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 22:05:45.799260 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-6aa13266-4d40-4d3e-b07f-e756103af6f6 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 51fd7e4e-4aea-426f-ae93-cd9dde475a9b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='87e2e140-6de8-4531-9681-d0a3e069622d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 22:05:45.881502 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-6aa13266-4d40-4d3e-b07f-e756103af6f6 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.886380 Jun 07 22:05:45.882764 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 240/451] 10.222.0.13 () {60 vars in 1146 bytes} [Tue Jun 7 22:05:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 889 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 22:05:45.894627 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-a1fc1bc5-cab1-4d8a-9429-4f16fc0f0176 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:45.897038 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-a1fc1bc5-cab1-4d8a-9429-4f16fc0f0176 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 51fd7e4e-4aea-426f-ae93-cd9dde475a9b] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:45.917117 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-ac8b4556-4b3e-4746-9394-f6b6294e6a32 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:45.917732 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-ac8b4556-4b3e-4746-9394-f6b6294e6a32 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 92b3a56b-7d09-4772-b1e4-c75b3971f7a5] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:45.925480 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ac8b4556-4b3e-4746-9394-f6b6294e6a32 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:45.926228 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ac8b4556-4b3e-4746-9394-f6b6294e6a32 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:45.927163 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ac8b4556-4b3e-4746-9394-f6b6294e6a32 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:45.928041 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ac8b4556-4b3e-4746-9394-f6b6294e6a32 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:46.259435 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-ac8b4556-4b3e-4746-9394-f6b6294e6a32 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:46.269739 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-ac8b4556-4b3e-4746-9394-f6b6294e6a32 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/92b3a56b-7d09-4772-b1e4-c75b3971f7a5" status: 200 len: 1509 microversion: 2.1 time: 0.368905 Jun 07 22:05:46.274999 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 241/452] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:45 2022] GET /compute/v2.1/servers/92b3a56b-7d09-4772-b1e4-c75b3971f7a5 => generated 1509 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:05:46.291117 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-a1fc1bc5-cab1-4d8a-9429-4f16fc0f0176 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce9ec4aea9449d3890f6dbb93f97968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc558dd3848d4d3d950d7cd408e19741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:46.301764 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-a1fc1bc5-cab1-4d8a-9429-4f16fc0f0176 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b" status: 200 len: 1213 microversion: 2.1 time: 0.410556 Jun 07 22:05:46.302378 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 212/453] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:45 2022] GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b => generated 1213 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:05:47.300784 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-2735f88f-137a-4a76-9f1c-0cf5ff31ba78 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:47.301394 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-2735f88f-137a-4a76-9f1c-0cf5ff31ba78 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 92b3a56b-7d09-4772-b1e4-c75b3971f7a5] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:47.305125 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:05:47.311164 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-2735f88f-137a-4a76-9f1c-0cf5ff31ba78 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:47.311637 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-2735f88f-137a-4a76-9f1c-0cf5ff31ba78 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:47.312411 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-2735f88f-137a-4a76-9f1c-0cf5ff31ba78 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:47.312846 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-2735f88f-137a-4a76-9f1c-0cf5ff31ba78 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:47.351276 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-b693158e-e9e5-49f6-9a18-faf5775d4c4d tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:47.352794 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-b693158e-e9e5-49f6-9a18-faf5775d4c4d tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 51fd7e4e-4aea-426f-ae93-cd9dde475a9b] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:47.359146 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-b693158e-e9e5-49f6-9a18-faf5775d4c4d tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:47.409925 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-b693158e-e9e5-49f6-9a18-faf5775d4c4d tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.051s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:47.410879 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-b693158e-e9e5-49f6-9a18-faf5775d4c4d tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:47.411604 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-b693158e-e9e5-49f6-9a18-faf5775d4c4d tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:47.519424 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-2735f88f-137a-4a76-9f1c-0cf5ff31ba78 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:47.528093 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-2735f88f-137a-4a76-9f1c-0cf5ff31ba78 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/92b3a56b-7d09-4772-b1e4-c75b3971f7a5" status: 200 len: 1509 microversion: 2.1 time: 0.239559 Jun 07 22:05:47.540581 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 242/454] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:47 2022] GET /compute/v2.1/servers/92b3a56b-7d09-4772-b1e4-c75b3971f7a5 => generated 1509 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:05:47.567395 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-b693158e-e9e5-49f6-9a18-faf5775d4c4d tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce9ec4aea9449d3890f6dbb93f97968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc558dd3848d4d3d950d7cd408e19741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:47.578288 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-b693158e-e9e5-49f6-9a18-faf5775d4c4d tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b" status: 200 len: 1209 microversion: 2.1 time: 0.259261 Jun 07 22:05:47.579522 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 213/455] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:47 2022] GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b => generated 1209 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:05:48.390926 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-1bbd7c96-708f-4ede-9774-9fd87df34937 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Action: 'create', calling method: .version_select at 0x7f92f1dd3ca0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-180023907", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDKYc0QbyR60qX4+72JrjbZ3Ghb3KoFetMolJ7OCxWVmycQ4v1eNCBQeJXp2pknCc6Umd7MCyYle31MT2f8fDLCxw5j7cMqUhpCqfVGGZbS0nnkptOy/mN+l+kmEIzqFwg=="}} {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:05:48.414324 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.quota [None req-1bbd7c96-708f-4ede-9774-9fd87df34937 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Getting quotas for project bd31cd38d46643fbac516d21ee4f89ac. Resources: {'key_pairs'} {{(pid=117971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 22:05:48.418918 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.quota [None req-1bbd7c96-708f-4ede-9774-9fd87df34937 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Getting quotas for user 7af02cd6ffd0484c8f6569629cd6313c and project bd31cd38d46643fbac516d21ee4f89ac. Resources: {'key_pairs'} {{(pid=117971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 22:05:48.472521 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-1bbd7c96-708f-4ede-9774-9fd87df34937 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.085643 Jun 07 22:05:48.474936 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 243/456] 10.222.0.13 () {60 vars in 1158 bytes} [Tue Jun 7 22:05:48 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:05:48.548823 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-46e4cabf-69cc-4689-9d81-0bb79ab8cba2 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:48.550103 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-46e4cabf-69cc-4689-9d81-0bb79ab8cba2 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 92b3a56b-7d09-4772-b1e4-c75b3971f7a5] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:48.557585 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-46e4cabf-69cc-4689-9d81-0bb79ab8cba2 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:48.558760 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-46e4cabf-69cc-4689-9d81-0bb79ab8cba2 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:48.559825 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-46e4cabf-69cc-4689-9d81-0bb79ab8cba2 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:48.560796 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-46e4cabf-69cc-4689-9d81-0bb79ab8cba2 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:48.594652 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-2698ab65-f640-4cf3-8de8-0b4e56352761 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-859087520", "imageRef": "640574d2-c95e-4fdb-b2c5-06602648b9d5", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-180023907", "networks": [{"uuid": "ca6cb110-b9a1-4286-8d84-ae1efa455584"}]}} {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:05:48.652225 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.network.neutron [None req-2698ab65-f640-4cf3-8de8-0b4e56352761 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] validate_networks() for [('ca6cb110-b9a1-4286-8d84-ae1efa455584', None, None, None, None, None)] {{(pid=117971) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 22:05:48.807282 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-46e4cabf-69cc-4689-9d81-0bb79ab8cba2 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:48.826123 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-46e4cabf-69cc-4689-9d81-0bb79ab8cba2 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/92b3a56b-7d09-4772-b1e4-c75b3971f7a5" status: 200 len: 1509 microversion: 2.1 time: 0.282475 Jun 07 22:05:48.827460 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 214/457] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:48 2022] GET /compute/v2.1/servers/92b3a56b-7d09-4772-b1e4-c75b3971f7a5 => generated 1509 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:05:48.832204 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-d2d45115-c912-4447-9586-88c59dbc6f2f tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:48.833177 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-d2d45115-c912-4447-9586-88c59dbc6f2f tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 51fd7e4e-4aea-426f-ae93-cd9dde475a9b] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:48.842573 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d2d45115-c912-4447-9586-88c59dbc6f2f tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:48.843255 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d2d45115-c912-4447-9586-88c59dbc6f2f tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:48.855539 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d2d45115-c912-4447-9586-88c59dbc6f2f tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:48.856282 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d2d45115-c912-4447-9586-88c59dbc6f2f tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:48.966939 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-d2d45115-c912-4447-9586-88c59dbc6f2f tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce9ec4aea9449d3890f6dbb93f97968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc558dd3848d4d3d950d7cd408e19741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:48.979433 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-d2d45115-c912-4447-9586-88c59dbc6f2f tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b" status: 200 len: 1209 microversion: 2.1 time: 0.150841 Jun 07 22:05:48.980008 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 215/458] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:48 2022] GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b => generated 1209 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:05:49.322550 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.virt.hardware [None req-2698ab65-f640-4cf3-8de8-0b4e56352761 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Flavor limits 0:0:0 {{(pid=117971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 22:05:49.322994 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.virt.hardware [None req-2698ab65-f640-4cf3-8de8-0b4e56352761 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Image limits 0:0:0 {{(pid=117971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 22:05:49.323678 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.virt.hardware [None req-2698ab65-f640-4cf3-8de8-0b4e56352761 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Flavor pref 0:0:0 {{(pid=117971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 22:05:49.324336 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.virt.hardware [None req-2698ab65-f640-4cf3-8de8-0b4e56352761 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Image pref 0:0:0 {{(pid=117971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 22:05:49.324937 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.virt.hardware [None req-2698ab65-f640-4cf3-8de8-0b4e56352761 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 22:05:49.336801 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-2698ab65-f640-4cf3-8de8-0b4e56352761 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:49.337528 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-2698ab65-f640-4cf3-8de8-0b4e56352761 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:49.338591 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-2698ab65-f640-4cf3-8de8-0b4e56352761 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:49.339185 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-2698ab65-f640-4cf3-8de8-0b4e56352761 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:49.358846 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.quota [None req-2698ab65-f640-4cf3-8de8-0b4e56352761 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Getting quotas for project bd31cd38d46643fbac516d21ee4f89ac. Resources: {'cores', 'ram', 'instances'} {{(pid=117971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 22:05:49.364170 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.quota [None req-2698ab65-f640-4cf3-8de8-0b4e56352761 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Getting quotas for user 7af02cd6ffd0484c8f6569629cd6313c and project bd31cd38d46643fbac516d21ee4f89ac. Resources: {'cores', 'ram', 'instances'} {{(pid=117971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 22:05:49.376861 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-2698ab65-f640-4cf3-8de8-0b4e56352761 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Going to run 1 instances... {{(pid=117971) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 22:05:49.379684 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-2698ab65-f640-4cf3-8de8-0b4e56352761 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='640574d2-c95e-4fdb-b2c5-06602648b9d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 22:05:49.438358 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-2698ab65-f640-4cf3-8de8-0b4e56352761 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.848155 Jun 07 22:05:49.440089 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 244/459] 10.222.0.13 () {60 vars in 1146 bytes} [Tue Jun 7 22:05:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 851 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 07 22:05:49.450833 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-3e9d53dc-9ef6-493f-8596-6f7e88e71be3 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:49.451893 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-3e9d53dc-9ef6-493f-8596-6f7e88e71be3 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:49.522884 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-3e9d53dc-9ef6-493f-8596-6f7e88e71be3 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af02cd6ffd0484c8f6569629cd6313c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31cd38d46643fbac516d21ee4f89ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:49.532679 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-3e9d53dc-9ef6-493f-8596-6f7e88e71be3 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b" status: 200 len: 1257 microversion: 2.1 time: 0.086154 Jun 07 22:05:49.544326 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 216/460] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:49 2022] GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b => generated 1257 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:05:49.845919 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-e3562ba2-dc7c-4445-b5ae-b328613033af tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:49.846656 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-e3562ba2-dc7c-4445-b5ae-b328613033af tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 92b3a56b-7d09-4772-b1e4-c75b3971f7a5] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:49.854762 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e3562ba2-dc7c-4445-b5ae-b328613033af tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:49.861988 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e3562ba2-dc7c-4445-b5ae-b328613033af tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:49.863232 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e3562ba2-dc7c-4445-b5ae-b328613033af tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:49.865068 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e3562ba2-dc7c-4445-b5ae-b328613033af tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:50.004716 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-883cc56a-36a1-4ad9-8c9c-6245e9207737 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:50.007584 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-883cc56a-36a1-4ad9-8c9c-6245e9207737 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 51fd7e4e-4aea-426f-ae93-cd9dde475a9b] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:50.022831 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-883cc56a-36a1-4ad9-8c9c-6245e9207737 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:50.023419 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-883cc56a-36a1-4ad9-8c9c-6245e9207737 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:50.030806 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-883cc56a-36a1-4ad9-8c9c-6245e9207737 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:50.031584 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-883cc56a-36a1-4ad9-8c9c-6245e9207737 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:50.117568 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-883cc56a-36a1-4ad9-8c9c-6245e9207737 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce9ec4aea9449d3890f6dbb93f97968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc558dd3848d4d3d950d7cd408e19741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:50.125771 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-883cc56a-36a1-4ad9-8c9c-6245e9207737 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b" status: 200 len: 1209 microversion: 2.1 time: 0.132415 Jun 07 22:05:50.126349 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 217/461] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:49 2022] GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b => generated 1209 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:05:50.467637 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-e3562ba2-dc7c-4445-b5ae-b328613033af tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:50.484871 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-e3562ba2-dc7c-4445-b5ae-b328613033af tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/92b3a56b-7d09-4772-b1e4-c75b3971f7a5" status: 200 len: 1509 microversion: 2.1 time: 0.644139 Jun 07 22:05:50.486517 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 245/462] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:49 2022] GET /compute/v2.1/servers/92b3a56b-7d09-4772-b1e4-c75b3971f7a5 => generated 1509 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:05:50.550353 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-ce850b65-5969-4233-b1b5-45d7c9ba9e26 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:50.551008 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-ce850b65-5969-4233-b1b5-45d7c9ba9e26 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:50.560477 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-ce850b65-5969-4233-b1b5-45d7c9ba9e26 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:50.562976 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-ce850b65-5969-4233-b1b5-45d7c9ba9e26 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:50.564392 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-ce850b65-5969-4233-b1b5-45d7c9ba9e26 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:50.565136 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-ce850b65-5969-4233-b1b5-45d7c9ba9e26 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:50.676555 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-ce850b65-5969-4233-b1b5-45d7c9ba9e26 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af02cd6ffd0484c8f6569629cd6313c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31cd38d46643fbac516d21ee4f89ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:50.684485 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-ce850b65-5969-4233-b1b5-45d7c9ba9e26 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b" status: 200 len: 1261 microversion: 2.1 time: 0.138182 Jun 07 22:05:50.685252 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 218/463] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:50 2022] GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b => generated 1261 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:05:51.144018 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-6f2ab109-1445-47f0-9818-2eb0fb745829 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:51.144616 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-6f2ab109-1445-47f0-9818-2eb0fb745829 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 51fd7e4e-4aea-426f-ae93-cd9dde475a9b] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:51.152255 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-6f2ab109-1445-47f0-9818-2eb0fb745829 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:51.152700 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-6f2ab109-1445-47f0-9818-2eb0fb745829 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:51.153675 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-6f2ab109-1445-47f0-9818-2eb0fb745829 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:51.154292 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-6f2ab109-1445-47f0-9818-2eb0fb745829 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:51.259886 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-6f2ab109-1445-47f0-9818-2eb0fb745829 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce9ec4aea9449d3890f6dbb93f97968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc558dd3848d4d3d950d7cd408e19741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:51.272437 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-6f2ab109-1445-47f0-9818-2eb0fb745829 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b" status: 200 len: 1209 microversion: 2.1 time: 0.132689 Jun 07 22:05:51.275134 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 246/464] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:51 2022] GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b => generated 1209 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:05:51.507901 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-ede12d8d-5560-4cc6-8501-ba64f6727fec tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:51.508768 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-ede12d8d-5560-4cc6-8501-ba64f6727fec tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 92b3a56b-7d09-4772-b1e4-c75b3971f7a5] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:51.531225 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-ede12d8d-5560-4cc6-8501-ba64f6727fec tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:51.531934 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-ede12d8d-5560-4cc6-8501-ba64f6727fec tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:51.533119 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-ede12d8d-5560-4cc6-8501-ba64f6727fec tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:51.534515 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-ede12d8d-5560-4cc6-8501-ba64f6727fec tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:51.701635 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-9dac5be9-dfcd-4d26-b41a-d03775abe9be tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:51.703447 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-9dac5be9-dfcd-4d26-b41a-d03775abe9be tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:51.717489 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-9dac5be9-dfcd-4d26-b41a-d03775abe9be tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:51.721605 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-9dac5be9-dfcd-4d26-b41a-d03775abe9be tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:51.723893 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-9dac5be9-dfcd-4d26-b41a-d03775abe9be tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:51.724353 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-9dac5be9-dfcd-4d26-b41a-d03775abe9be tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:51.811055 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-ede12d8d-5560-4cc6-8501-ba64f6727fec tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:51.830538 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-ede12d8d-5560-4cc6-8501-ba64f6727fec tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/92b3a56b-7d09-4772-b1e4-c75b3971f7a5" status: 200 len: 1509 microversion: 2.1 time: 0.329479 Jun 07 22:05:51.834264 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 219/465] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:51 2022] GET /compute/v2.1/servers/92b3a56b-7d09-4772-b1e4-c75b3971f7a5 => generated 1509 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:05:51.894386 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-9dac5be9-dfcd-4d26-b41a-d03775abe9be tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af02cd6ffd0484c8f6569629cd6313c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31cd38d46643fbac516d21ee4f89ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:51.909412 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-9dac5be9-dfcd-4d26-b41a-d03775abe9be tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b" status: 200 len: 1261 microversion: 2.1 time: 0.211789 Jun 07 22:05:51.910784 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 247/466] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:51 2022] GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b => generated 1261 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:05:52.290866 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-6830191c-b1f2-408b-845f-7168c678b4ce tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:52.291819 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-6830191c-b1f2-408b-845f-7168c678b4ce tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 51fd7e4e-4aea-426f-ae93-cd9dde475a9b] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:52.302124 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6830191c-b1f2-408b-845f-7168c678b4ce tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:52.304430 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6830191c-b1f2-408b-845f-7168c678b4ce tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:52.306816 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6830191c-b1f2-408b-845f-7168c678b4ce tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:52.308378 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6830191c-b1f2-408b-845f-7168c678b4ce tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:52.424720 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-6830191c-b1f2-408b-845f-7168c678b4ce tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce9ec4aea9449d3890f6dbb93f97968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc558dd3848d4d3d950d7cd408e19741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:52.438017 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-6830191c-b1f2-408b-845f-7168c678b4ce tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b" status: 200 len: 1209 microversion: 2.1 time: 0.152877 Jun 07 22:05:52.438615 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 220/467] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:52 2022] GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b => generated 1209 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:05:52.848371 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-91a1b882-8769-4ff5-854f-49a7ca2116d4 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:52.848944 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-91a1b882-8769-4ff5-854f-49a7ca2116d4 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 92b3a56b-7d09-4772-b1e4-c75b3971f7a5] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:52.861812 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-91a1b882-8769-4ff5-854f-49a7ca2116d4 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:52.862509 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-91a1b882-8769-4ff5-854f-49a7ca2116d4 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:52.863748 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-91a1b882-8769-4ff5-854f-49a7ca2116d4 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:52.864814 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-91a1b882-8769-4ff5-854f-49a7ca2116d4 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:52.926398 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-951811b6-ca63-42ae-946d-65f9e786b9e1 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:52.927595 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-951811b6-ca63-42ae-946d-65f9e786b9e1 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:52.937254 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-951811b6-ca63-42ae-946d-65f9e786b9e1 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:52.937705 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-951811b6-ca63-42ae-946d-65f9e786b9e1 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:52.938481 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-951811b6-ca63-42ae-946d-65f9e786b9e1 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:52.938922 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-951811b6-ca63-42ae-946d-65f9e786b9e1 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:53.050220 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-91a1b882-8769-4ff5-854f-49a7ca2116d4 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:53.060401 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-91a1b882-8769-4ff5-854f-49a7ca2116d4 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/92b3a56b-7d09-4772-b1e4-c75b3971f7a5" status: 200 len: 1509 microversion: 2.1 time: 0.215035 Jun 07 22:05:53.061228 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 248/468] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:52 2022] GET /compute/v2.1/servers/92b3a56b-7d09-4772-b1e4-c75b3971f7a5 => generated 1509 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:05:53.233419 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-951811b6-ca63-42ae-946d-65f9e786b9e1 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af02cd6ffd0484c8f6569629cd6313c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31cd38d46643fbac516d21ee4f89ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:53.251974 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-951811b6-ca63-42ae-946d-65f9e786b9e1 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b" status: 200 len: 1261 microversion: 2.1 time: 0.329690 Jun 07 22:05:53.252926 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 221/469] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:52 2022] GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b => generated 1261 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:05:53.455167 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-7b5c201b-63b7-44da-8a84-b173c9932a39 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:53.455813 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-7b5c201b-63b7-44da-8a84-b173c9932a39 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 51fd7e4e-4aea-426f-ae93-cd9dde475a9b] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:53.462405 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-7b5c201b-63b7-44da-8a84-b173c9932a39 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:53.462855 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-7b5c201b-63b7-44da-8a84-b173c9932a39 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:53.463662 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-7b5c201b-63b7-44da-8a84-b173c9932a39 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:53.464096 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-7b5c201b-63b7-44da-8a84-b173c9932a39 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:53.532294 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-7b5c201b-63b7-44da-8a84-b173c9932a39 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce9ec4aea9449d3890f6dbb93f97968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc558dd3848d4d3d950d7cd408e19741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:53.540775 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-7b5c201b-63b7-44da-8a84-b173c9932a39 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b" status: 200 len: 1265 microversion: 2.1 time: 0.089294 Jun 07 22:05:53.541356 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 249/470] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:53 2022] GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b => generated 1265 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:05:54.077940 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-949025ae-c6e5-4d63-a3a9-4fc0a1222cbc tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:54.078568 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-949025ae-c6e5-4d63-a3a9-4fc0a1222cbc tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 92b3a56b-7d09-4772-b1e4-c75b3971f7a5] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:54.085331 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-949025ae-c6e5-4d63-a3a9-4fc0a1222cbc tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:54.085697 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-949025ae-c6e5-4d63-a3a9-4fc0a1222cbc tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:54.086437 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-949025ae-c6e5-4d63-a3a9-4fc0a1222cbc tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:54.086870 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-949025ae-c6e5-4d63-a3a9-4fc0a1222cbc tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:54.179944 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-622551be-37be-4310-9b05-06c40b9fee24 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Action: 'create', calling method: .version_select at 0x7f92f16b65e0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1489617035", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLItWm+mfGCBAyV3LXPDz6WjQEkH4I7D8JaPl4uBBpR8sXhlAEK3edw9987vSoSifkfnl3QqSZkklk0tobmYAbeZbuTVQLEVcrThhxJtprE/k5HxvQ9JwsRlKynd2LOTFA=="}} {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:05:54.196366 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.quota [None req-622551be-37be-4310-9b05-06c40b9fee24 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Getting quotas for project 579eb78d8af74e2cadce3a0c793b4440. Resources: {'key_pairs'} {{(pid=117970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 22:05:54.200551 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.quota [None req-622551be-37be-4310-9b05-06c40b9fee24 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Getting quotas for user c710942802df49ec8bd630e4b225eed2 and project 579eb78d8af74e2cadce3a0c793b4440. Resources: {'key_pairs'} {{(pid=117970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 22:05:54.223808 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-622551be-37be-4310-9b05-06c40b9fee24 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.276802 Jun 07 22:05:54.224503 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 222/471] 10.222.0.13 () {60 vars in 1158 bytes} [Tue Jun 7 22:05:53 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:05:54.229463 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-949025ae-c6e5-4d63-a3a9-4fc0a1222cbc tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:54.237639 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-949025ae-c6e5-4d63-a3a9-4fc0a1222cbc tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/92b3a56b-7d09-4772-b1e4-c75b3971f7a5" status: 200 len: 1509 microversion: 2.1 time: 0.163574 Jun 07 22:05:54.238218 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 250/472] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:54 2022] GET /compute/v2.1/servers/92b3a56b-7d09-4772-b1e4-c75b3971f7a5 => generated 1509 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:05:54.269205 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-141291ca-5847-4992-95e2-94cf94ccea70 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:54.269912 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-141291ca-5847-4992-95e2-94cf94ccea70 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:54.277325 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-141291ca-5847-4992-95e2-94cf94ccea70 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:54.278092 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-141291ca-5847-4992-95e2-94cf94ccea70 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:54.279120 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-141291ca-5847-4992-95e2-94cf94ccea70 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:54.279818 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-141291ca-5847-4992-95e2-94cf94ccea70 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:54.371879 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-141291ca-5847-4992-95e2-94cf94ccea70 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af02cd6ffd0484c8f6569629cd6313c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31cd38d46643fbac516d21ee4f89ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:54.382399 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-141291ca-5847-4992-95e2-94cf94ccea70 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b" status: 200 len: 1253 microversion: 2.1 time: 0.116970 Jun 07 22:05:54.383138 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 223/473] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:54 2022] GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b => generated 1253 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:05:54.558223 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-0efa33b5-aac8-4860-a0fb-5b9da77f82b9 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:54.558876 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-0efa33b5-aac8-4860-a0fb-5b9da77f82b9 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 51fd7e4e-4aea-426f-ae93-cd9dde475a9b] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:54.566049 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-0efa33b5-aac8-4860-a0fb-5b9da77f82b9 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:54.566472 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-0efa33b5-aac8-4860-a0fb-5b9da77f82b9 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:54.567390 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-0efa33b5-aac8-4860-a0fb-5b9da77f82b9 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:54.567828 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-0efa33b5-aac8-4860-a0fb-5b9da77f82b9 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:54.644767 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-0efa33b5-aac8-4860-a0fb-5b9da77f82b9 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce9ec4aea9449d3890f6dbb93f97968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc558dd3848d4d3d950d7cd408e19741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:54.652737 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-0efa33b5-aac8-4860-a0fb-5b9da77f82b9 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b" status: 200 len: 1265 microversion: 2.1 time: 0.099088 Jun 07 22:05:54.653305 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 251/474] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:54 2022] GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b => generated 1265 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:05:55.254318 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-c7429047-5535-4e7f-ba65-695ad7fc97a8 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:55.255094 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-c7429047-5535-4e7f-ba65-695ad7fc97a8 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 92b3a56b-7d09-4772-b1e4-c75b3971f7a5] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:55.268720 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c7429047-5535-4e7f-ba65-695ad7fc97a8 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:55.269345 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c7429047-5535-4e7f-ba65-695ad7fc97a8 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:55.269925 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c7429047-5535-4e7f-ba65-695ad7fc97a8 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:55.270355 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c7429047-5535-4e7f-ba65-695ad7fc97a8 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:55.402230 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-0a347960-5ca2-4d6d-ae32-2d7e88e53987 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:55.403596 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-0a347960-5ca2-4d6d-ae32-2d7e88e53987 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:55.412618 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-0a347960-5ca2-4d6d-ae32-2d7e88e53987 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:55.414240 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-0a347960-5ca2-4d6d-ae32-2d7e88e53987 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:55.415304 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-0a347960-5ca2-4d6d-ae32-2d7e88e53987 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:55.415982 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-0a347960-5ca2-4d6d-ae32-2d7e88e53987 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:55.419237 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-c7429047-5535-4e7f-ba65-695ad7fc97a8 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:55.427740 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-c7429047-5535-4e7f-ba65-695ad7fc97a8 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/92b3a56b-7d09-4772-b1e4-c75b3971f7a5" status: 200 len: 1509 microversion: 2.1 time: 0.177501 Jun 07 22:05:55.429389 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 224/475] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:55 2022] GET /compute/v2.1/servers/92b3a56b-7d09-4772-b1e4-c75b3971f7a5 => generated 1509 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:05:55.502672 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-0a347960-5ca2-4d6d-ae32-2d7e88e53987 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af02cd6ffd0484c8f6569629cd6313c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31cd38d46643fbac516d21ee4f89ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:55.512525 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-0a347960-5ca2-4d6d-ae32-2d7e88e53987 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b" status: 200 len: 1253 microversion: 2.1 time: 0.116151 Jun 07 22:05:55.513103 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 252/476] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:55 2022] GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b => generated 1253 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:05:55.670573 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-2a34599c-dc72-44f3-8c2f-4744fe346304 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:55.671053 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-2a34599c-dc72-44f3-8c2f-4744fe346304 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 51fd7e4e-4aea-426f-ae93-cd9dde475a9b] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:55.679831 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-2a34599c-dc72-44f3-8c2f-4744fe346304 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:55.680237 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-2a34599c-dc72-44f3-8c2f-4744fe346304 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:55.683689 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-2a34599c-dc72-44f3-8c2f-4744fe346304 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:55.684226 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-2a34599c-dc72-44f3-8c2f-4744fe346304 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:55.780367 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-2a34599c-dc72-44f3-8c2f-4744fe346304 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce9ec4aea9449d3890f6dbb93f97968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc558dd3848d4d3d950d7cd408e19741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:55.790636 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-2a34599c-dc72-44f3-8c2f-4744fe346304 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b" status: 200 len: 1265 microversion: 2.1 time: 0.123875 Jun 07 22:05:55.792062 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 225/477] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:55 2022] GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b => generated 1265 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:05:56.445612 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-60a7c289-f76c-4167-b242-b7f4c05bfb22 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:56.446214 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-60a7c289-f76c-4167-b242-b7f4c05bfb22 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 92b3a56b-7d09-4772-b1e4-c75b3971f7a5] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:56.453442 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-60a7c289-f76c-4167-b242-b7f4c05bfb22 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:56.453766 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-60a7c289-f76c-4167-b242-b7f4c05bfb22 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:56.454530 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-60a7c289-f76c-4167-b242-b7f4c05bfb22 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:56.454972 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-60a7c289-f76c-4167-b242-b7f4c05bfb22 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:56.529729 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-6c888e78-3460-43b8-9644-b7e72c80bf61 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:56.530480 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-6c888e78-3460-43b8-9644-b7e72c80bf61 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:56.536782 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6c888e78-3460-43b8-9644-b7e72c80bf61 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:56.537230 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6c888e78-3460-43b8-9644-b7e72c80bf61 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:56.538308 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6c888e78-3460-43b8-9644-b7e72c80bf61 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:56.538885 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6c888e78-3460-43b8-9644-b7e72c80bf61 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:56.624071 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-6c888e78-3460-43b8-9644-b7e72c80bf61 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af02cd6ffd0484c8f6569629cd6313c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31cd38d46643fbac516d21ee4f89ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:56.634039 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-6c888e78-3460-43b8-9644-b7e72c80bf61 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b" status: 200 len: 1253 microversion: 2.1 time: 0.108084 Jun 07 22:05:56.634867 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 226/478] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:56 2022] GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b => generated 1253 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:05:56.651050 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-60a7c289-f76c-4167-b242-b7f4c05bfb22 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:56.660521 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-60a7c289-f76c-4167-b242-b7f4c05bfb22 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/92b3a56b-7d09-4772-b1e4-c75b3971f7a5" status: 200 len: 1509 microversion: 2.1 time: 0.219051 Jun 07 22:05:56.661097 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 253/479] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:56 2022] GET /compute/v2.1/servers/92b3a56b-7d09-4772-b1e4-c75b3971f7a5 => generated 1509 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:05:56.809369 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-1a9bf941-f0e5-4d5c-aea1-5bf07587dc2d tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:56.809989 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-1a9bf941-f0e5-4d5c-aea1-5bf07587dc2d tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 51fd7e4e-4aea-426f-ae93-cd9dde475a9b] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:56.817504 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1a9bf941-f0e5-4d5c-aea1-5bf07587dc2d tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:56.818208 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1a9bf941-f0e5-4d5c-aea1-5bf07587dc2d tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:56.818983 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1a9bf941-f0e5-4d5c-aea1-5bf07587dc2d tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:56.820117 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1a9bf941-f0e5-4d5c-aea1-5bf07587dc2d tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:56.888497 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-1a9bf941-f0e5-4d5c-aea1-5bf07587dc2d tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce9ec4aea9449d3890f6dbb93f97968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc558dd3848d4d3d950d7cd408e19741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:56.896207 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-1a9bf941-f0e5-4d5c-aea1-5bf07587dc2d tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b" status: 200 len: 1265 microversion: 2.1 time: 0.090941 Jun 07 22:05:56.896776 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 227/480] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:56 2022] GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b => generated 1265 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:05:57.650178 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-8787de87-fbe9-421f-a962-3f4af27b07b5 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:57.650737 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-8787de87-fbe9-421f-a962-3f4af27b07b5 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:57.659051 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-8787de87-fbe9-421f-a962-3f4af27b07b5 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:57.659554 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-8787de87-fbe9-421f-a962-3f4af27b07b5 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:57.660325 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-8787de87-fbe9-421f-a962-3f4af27b07b5 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:57.660763 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-8787de87-fbe9-421f-a962-3f4af27b07b5 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:57.678132 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-8980df5b-0589-444c-8e5b-e216f2fc10e5 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:57.679604 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-8980df5b-0589-444c-8e5b-e216f2fc10e5 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 92b3a56b-7d09-4772-b1e4-c75b3971f7a5] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:57.696502 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-8980df5b-0589-444c-8e5b-e216f2fc10e5 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:57.700028 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-8980df5b-0589-444c-8e5b-e216f2fc10e5 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:57.700958 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-8980df5b-0589-444c-8e5b-e216f2fc10e5 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:57.702795 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-8980df5b-0589-444c-8e5b-e216f2fc10e5 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:57.749256 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-8787de87-fbe9-421f-a962-3f4af27b07b5 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af02cd6ffd0484c8f6569629cd6313c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31cd38d46643fbac516d21ee4f89ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:57.758442 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-8787de87-fbe9-421f-a962-3f4af27b07b5 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b" status: 200 len: 1253 microversion: 2.1 time: 0.112173 Jun 07 22:05:57.768648 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 254/481] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:57 2022] GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b => generated 1253 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:05:57.893219 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-8980df5b-0589-444c-8e5b-e216f2fc10e5 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:57.915197 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-8980df5b-0589-444c-8e5b-e216f2fc10e5 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/92b3a56b-7d09-4772-b1e4-c75b3971f7a5" status: 200 len: 1509 microversion: 2.1 time: 0.240757 Jun 07 22:05:57.916930 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 228/482] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:57 2022] GET /compute/v2.1/servers/92b3a56b-7d09-4772-b1e4-c75b3971f7a5 => generated 1509 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:05:57.917513 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-a87ed0d5-e77c-4a37-9cf6-c4b2dfe22464 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:57.918716 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-a87ed0d5-e77c-4a37-9cf6-c4b2dfe22464 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 51fd7e4e-4aea-426f-ae93-cd9dde475a9b] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:57.925564 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a87ed0d5-e77c-4a37-9cf6-c4b2dfe22464 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:57.926329 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a87ed0d5-e77c-4a37-9cf6-c4b2dfe22464 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:57.927394 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a87ed0d5-e77c-4a37-9cf6-c4b2dfe22464 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:57.928042 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a87ed0d5-e77c-4a37-9cf6-c4b2dfe22464 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:58.040674 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-a87ed0d5-e77c-4a37-9cf6-c4b2dfe22464 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce9ec4aea9449d3890f6dbb93f97968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc558dd3848d4d3d950d7cd408e19741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:58.051892 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-a87ed0d5-e77c-4a37-9cf6-c4b2dfe22464 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b" status: 200 len: 1273 microversion: 2.1 time: 0.139417 Jun 07 22:05:58.053092 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 255/483] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:57 2022] GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b => generated 1273 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:05:58.776110 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-9641f986-66e5-4d4b-b392-d037c70536a7 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:58.776727 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-9641f986-66e5-4d4b-b392-d037c70536a7 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:58.782736 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-9641f986-66e5-4d4b-b392-d037c70536a7 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:58.783273 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-9641f986-66e5-4d4b-b392-d037c70536a7 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:58.784142 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-9641f986-66e5-4d4b-b392-d037c70536a7 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:58.784648 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-9641f986-66e5-4d4b-b392-d037c70536a7 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:58.866668 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-9641f986-66e5-4d4b-b392-d037c70536a7 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af02cd6ffd0484c8f6569629cd6313c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31cd38d46643fbac516d21ee4f89ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:58.877116 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-9641f986-66e5-4d4b-b392-d037c70536a7 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b" status: 200 len: 1309 microversion: 2.1 time: 0.105233 Jun 07 22:05:58.878042 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 229/484] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:58 2022] GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b => generated 1309 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:05:58.935623 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-fb78156e-54cd-403c-9cfc-7832d3f84e8f tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:58.936923 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-fb78156e-54cd-403c-9cfc-7832d3f84e8f tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 92b3a56b-7d09-4772-b1e4-c75b3971f7a5] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:58.943859 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-fb78156e-54cd-403c-9cfc-7832d3f84e8f tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:58.944601 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-fb78156e-54cd-403c-9cfc-7832d3f84e8f tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:58.945552 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-fb78156e-54cd-403c-9cfc-7832d3f84e8f tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:58.945989 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-fb78156e-54cd-403c-9cfc-7832d3f84e8f tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:59.075065 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-f6798d15-6207-457c-bb8e-b71fd47a6af5 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:59.076224 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-f6798d15-6207-457c-bb8e-b71fd47a6af5 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 51fd7e4e-4aea-426f-ae93-cd9dde475a9b] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:59.085547 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f6798d15-6207-457c-bb8e-b71fd47a6af5 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:59.088626 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f6798d15-6207-457c-bb8e-b71fd47a6af5 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:59.089824 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f6798d15-6207-457c-bb8e-b71fd47a6af5 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:59.090281 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f6798d15-6207-457c-bb8e-b71fd47a6af5 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:59.093574 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-fb78156e-54cd-403c-9cfc-7832d3f84e8f tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:59.095050 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_cell1:SELECT=100 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:05:59.099763 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:05:59.115140 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-fb78156e-54cd-403c-9cfc-7832d3f84e8f tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/92b3a56b-7d09-4772-b1e4-c75b3971f7a5" status: 200 len: 1515 microversion: 2.1 time: 0.177142 Jun 07 22:05:59.133375 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 256/485] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:58 2022] GET /compute/v2.1/servers/92b3a56b-7d09-4772-b1e4-c75b3971f7a5 => generated 1515 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:05:59.470278 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-f6798d15-6207-457c-bb8e-b71fd47a6af5 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce9ec4aea9449d3890f6dbb93f97968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc558dd3848d4d3d950d7cd408e19741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:05:59.480813 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-f6798d15-6207-457c-bb8e-b71fd47a6af5 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b" status: 200 len: 1313 microversion: 2.1 time: 0.412733 Jun 07 22:05:59.484881 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 230/486] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:59 2022] GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b => generated 1313 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:05:59.896289 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-b296d76d-e562-4e7c-a947-cee1d6abdd34 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:05:59.897947 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-b296d76d-e562-4e7c-a947-cee1d6abdd34 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:05:59.908220 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_cell0:SELECT=4 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:05:59.910587 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_cell0:SELECT=16 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:05:59.912738 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b296d76d-e562-4e7c-a947-cee1d6abdd34 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:59.914826 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b296d76d-e562-4e7c-a947-cee1d6abdd34 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:05:59.915872 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b296d76d-e562-4e7c-a947-cee1d6abdd34 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:05:59.916495 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b296d76d-e562-4e7c-a947-cee1d6abdd34 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:00.033352 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-b296d76d-e562-4e7c-a947-cee1d6abdd34 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af02cd6ffd0484c8f6569629cd6313c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31cd38d46643fbac516d21ee4f89ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:00.046131 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-b296d76d-e562-4e7c-a947-cee1d6abdd34 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b" status: 200 len: 1315 microversion: 2.1 time: 0.155258 Jun 07 22:06:00.057674 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 257/487] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:05:59 2022] GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:00.501717 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-779a60da-00e0-4b02-bcca-56392c6bc07f tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:00.502459 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-779a60da-00e0-4b02-bcca-56392c6bc07f tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 51fd7e4e-4aea-426f-ae93-cd9dde475a9b] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:00.509374 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-779a60da-00e0-4b02-bcca-56392c6bc07f tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:00.509813 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-779a60da-00e0-4b02-bcca-56392c6bc07f tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:00.510577 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-779a60da-00e0-4b02-bcca-56392c6bc07f tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:00.511009 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-779a60da-00e0-4b02-bcca-56392c6bc07f tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:00.794190 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-779a60da-00e0-4b02-bcca-56392c6bc07f tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce9ec4aea9449d3890f6dbb93f97968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc558dd3848d4d3d950d7cd408e19741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:00.801990 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-779a60da-00e0-4b02-bcca-56392c6bc07f tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b" status: 200 len: 1313 microversion: 2.1 time: 0.304310 Jun 07 22:06:00.802567 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 231/488] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:00 2022] GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b => generated 1313 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:00.819740 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [req-ef05f3ba-22ca-4023-96a1-8d72f6cf3975 req-378afb1b-108f-47c1-9bb3-f7e5ee6db932 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51fd7e4e-4aea-426f-ae93-cd9dde475a9b", "tag": "fbaaf338-165c-44a5-9c49-6020632ff9bc"}]} {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:06:00.829307 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-ef05f3ba-22ca-4023-96a1-8d72f6cf3975 req-378afb1b-108f-47c1-9bb3-f7e5ee6db932 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:00.829307 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-ef05f3ba-22ca-4023-96a1-8d72f6cf3975 req-378afb1b-108f-47c1-9bb3-f7e5ee6db932 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:00.842198 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.compute.server_external_events [req-ef05f3ba-22ca-4023-96a1-8d72f6cf3975 req-378afb1b-108f-47c1-9bb3-f7e5ee6db932 service nova] Creating event network-changed:fbaaf338-165c-44a5-9c49-6020632ff9bc for instance 51fd7e4e-4aea-426f-ae93-cd9dde475a9b on hv-cinder-83552 Jun 07 22:06:00.847159 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [req-ef05f3ba-22ca-4023-96a1-8d72f6cf3975 req-378afb1b-108f-47c1-9bb3-f7e5ee6db932 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034393 Jun 07 22:06:00.847806 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 258/489] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:06:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:06:01.064183 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-632a4339-2177-48fa-a47a-9e25d7999976 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:01.064792 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-632a4339-2177-48fa-a47a-9e25d7999976 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:01.070949 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-632a4339-2177-48fa-a47a-9e25d7999976 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:01.071442 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-632a4339-2177-48fa-a47a-9e25d7999976 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:01.072205 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-632a4339-2177-48fa-a47a-9e25d7999976 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:01.072643 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-632a4339-2177-48fa-a47a-9e25d7999976 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:01.202043 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-632a4339-2177-48fa-a47a-9e25d7999976 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af02cd6ffd0484c8f6569629cd6313c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31cd38d46643fbac516d21ee4f89ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:01.209403 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-632a4339-2177-48fa-a47a-9e25d7999976 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b" status: 200 len: 1357 microversion: 2.1 time: 0.149264 Jun 07 22:06:01.210733 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 232/490] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:01 2022] GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b => generated 1357 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:01.821565 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-682bfca9-1411-4aaa-8105-22eb0e8d0645 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:01.822942 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-682bfca9-1411-4aaa-8105-22eb0e8d0645 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 51fd7e4e-4aea-426f-ae93-cd9dde475a9b] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:01.829820 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-682bfca9-1411-4aaa-8105-22eb0e8d0645 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:01.830270 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-682bfca9-1411-4aaa-8105-22eb0e8d0645 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:01.831038 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-682bfca9-1411-4aaa-8105-22eb0e8d0645 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:01.831524 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-682bfca9-1411-4aaa-8105-22eb0e8d0645 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:01.960756 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-682bfca9-1411-4aaa-8105-22eb0e8d0645 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce9ec4aea9449d3890f6dbb93f97968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc558dd3848d4d3d950d7cd408e19741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:01.968196 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-682bfca9-1411-4aaa-8105-22eb0e8d0645 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b" status: 200 len: 1313 microversion: 2.1 time: 0.152626 Jun 07 22:06:01.968764 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 259/491] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:01 2022] GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:02.226858 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-6e7bb700-09a5-4882-8834-0d74c391782c tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:02.227575 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-6e7bb700-09a5-4882-8834-0d74c391782c tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:02.233569 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6e7bb700-09a5-4882-8834-0d74c391782c tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:02.234009 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6e7bb700-09a5-4882-8834-0d74c391782c tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:02.234755 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6e7bb700-09a5-4882-8834-0d74c391782c tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:02.235211 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6e7bb700-09a5-4882-8834-0d74c391782c tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:02.365482 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-6e7bb700-09a5-4882-8834-0d74c391782c tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af02cd6ffd0484c8f6569629cd6313c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31cd38d46643fbac516d21ee4f89ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:02.373495 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-6e7bb700-09a5-4882-8834-0d74c391782c tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b" status: 200 len: 1357 microversion: 2.1 time: 0.150722 Jun 07 22:06:02.374053 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 233/492] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:02 2022] GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:02.985655 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-ac612e83-f6ae-4e0f-85d5-d3390d44efbf tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:02.986177 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-ac612e83-f6ae-4e0f-85d5-d3390d44efbf tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 51fd7e4e-4aea-426f-ae93-cd9dde475a9b] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:02.993882 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ac612e83-f6ae-4e0f-85d5-d3390d44efbf tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:02.994334 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ac612e83-f6ae-4e0f-85d5-d3390d44efbf tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:02.995108 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ac612e83-f6ae-4e0f-85d5-d3390d44efbf tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:02.995652 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ac612e83-f6ae-4e0f-85d5-d3390d44efbf tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:03.158424 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-ac612e83-f6ae-4e0f-85d5-d3390d44efbf tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce9ec4aea9449d3890f6dbb93f97968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc558dd3848d4d3d950d7cd408e19741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:03.176115 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-ac612e83-f6ae-4e0f-85d5-d3390d44efbf tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b" status: 200 len: 1313 microversion: 2.1 time: 0.194282 Jun 07 22:06:03.183103 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 260/493] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:02 2022] GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b => generated 1313 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:03.390852 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-be2c0a87-cf5a-41cb-a24e-6bd96cf0d423 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:03.391646 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-be2c0a87-cf5a-41cb-a24e-6bd96cf0d423 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:03.398032 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-be2c0a87-cf5a-41cb-a24e-6bd96cf0d423 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:03.398564 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-be2c0a87-cf5a-41cb-a24e-6bd96cf0d423 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:03.399603 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-be2c0a87-cf5a-41cb-a24e-6bd96cf0d423 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:03.400103 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-be2c0a87-cf5a-41cb-a24e-6bd96cf0d423 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:03.543397 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-be2c0a87-cf5a-41cb-a24e-6bd96cf0d423 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af02cd6ffd0484c8f6569629cd6313c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31cd38d46643fbac516d21ee4f89ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:03.550753 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-be2c0a87-cf5a-41cb-a24e-6bd96cf0d423 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b" status: 200 len: 1357 microversion: 2.1 time: 0.163919 Jun 07 22:06:03.551319 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 234/494] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:03 2022] GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:04.194110 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-01b3009e-dca8-4fc5-bce9-3c0a3eaad618 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:04.194827 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-01b3009e-dca8-4fc5-bce9-3c0a3eaad618 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 51fd7e4e-4aea-426f-ae93-cd9dde475a9b] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:04.201331 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-01b3009e-dca8-4fc5-bce9-3c0a3eaad618 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:04.201779 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-01b3009e-dca8-4fc5-bce9-3c0a3eaad618 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:04.202537 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-01b3009e-dca8-4fc5-bce9-3c0a3eaad618 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:04.202970 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-01b3009e-dca8-4fc5-bce9-3c0a3eaad618 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:04.337253 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-01b3009e-dca8-4fc5-bce9-3c0a3eaad618 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce9ec4aea9449d3890f6dbb93f97968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc558dd3848d4d3d950d7cd408e19741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:04.344707 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-01b3009e-dca8-4fc5-bce9-3c0a3eaad618 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b" status: 200 len: 1313 microversion: 2.1 time: 0.154604 Jun 07 22:06:04.345277 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 261/495] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:04 2022] GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:04.570615 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-8a2a8a83-8e36-4b75-9c92-f84f35c834c3 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:04.571263 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-8a2a8a83-8e36-4b75-9c92-f84f35c834c3 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:04.574430 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_cell0:SELECT=8 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:06:04.578243 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-8a2a8a83-8e36-4b75-9c92-f84f35c834c3 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:04.578686 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-8a2a8a83-8e36-4b75-9c92-f84f35c834c3 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:04.579474 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-8a2a8a83-8e36-4b75-9c92-f84f35c834c3 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:04.579906 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-8a2a8a83-8e36-4b75-9c92-f84f35c834c3 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:04.711847 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-8a2a8a83-8e36-4b75-9c92-f84f35c834c3 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af02cd6ffd0484c8f6569629cd6313c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31cd38d46643fbac516d21ee4f89ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:04.719177 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-8a2a8a83-8e36-4b75-9c92-f84f35c834c3 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b" status: 200 len: 1357 microversion: 2.1 time: 0.153117 Jun 07 22:06:04.719763 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 235/496] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:04 2022] GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:05.362217 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-cf560320-2a86-4eab-8d7f-fe6a00ac229b tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:05.362893 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-cf560320-2a86-4eab-8d7f-fe6a00ac229b tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 51fd7e4e-4aea-426f-ae93-cd9dde475a9b] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:05.370450 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-cf560320-2a86-4eab-8d7f-fe6a00ac229b tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:05.370937 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-cf560320-2a86-4eab-8d7f-fe6a00ac229b tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:05.371763 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-cf560320-2a86-4eab-8d7f-fe6a00ac229b tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:05.372303 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-cf560320-2a86-4eab-8d7f-fe6a00ac229b tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:05.511523 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-cf560320-2a86-4eab-8d7f-fe6a00ac229b tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce9ec4aea9449d3890f6dbb93f97968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc558dd3848d4d3d950d7cd408e19741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:05.519045 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-cf560320-2a86-4eab-8d7f-fe6a00ac229b tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b" status: 200 len: 1313 microversion: 2.1 time: 0.160702 Jun 07 22:06:05.519637 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 262/497] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:05 2022] GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:05.736223 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-c0ff5639-7f19-490e-b609-364612665b8f tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:05.736863 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-c0ff5639-7f19-490e-b609-364612665b8f tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:05.743331 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c0ff5639-7f19-490e-b609-364612665b8f tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:05.743796 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c0ff5639-7f19-490e-b609-364612665b8f tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:05.744545 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c0ff5639-7f19-490e-b609-364612665b8f tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:05.744973 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c0ff5639-7f19-490e-b609-364612665b8f tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:05.877840 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-c0ff5639-7f19-490e-b609-364612665b8f tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af02cd6ffd0484c8f6569629cd6313c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31cd38d46643fbac516d21ee4f89ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:05.886583 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-c0ff5639-7f19-490e-b609-364612665b8f tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b" status: 200 len: 1357 microversion: 2.1 time: 0.154182 Jun 07 22:06:05.887159 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 236/498] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:05 2022] GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:06.537027 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-ee92b137-5ce2-4b26-8903-03a081c294ad tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:06.537918 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-ee92b137-5ce2-4b26-8903-03a081c294ad tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 51fd7e4e-4aea-426f-ae93-cd9dde475a9b] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:06.545104 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ee92b137-5ce2-4b26-8903-03a081c294ad tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:06.545560 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ee92b137-5ce2-4b26-8903-03a081c294ad tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:06.546327 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ee92b137-5ce2-4b26-8903-03a081c294ad tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:06.546760 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ee92b137-5ce2-4b26-8903-03a081c294ad tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:06.704526 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-ee92b137-5ce2-4b26-8903-03a081c294ad tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce9ec4aea9449d3890f6dbb93f97968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc558dd3848d4d3d950d7cd408e19741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:06.713221 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-ee92b137-5ce2-4b26-8903-03a081c294ad tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b" status: 200 len: 1313 microversion: 2.1 time: 0.180256 Jun 07 22:06:06.713787 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 263/499] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:06 2022] GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b => generated 1313 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:06.903487 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-789f3297-a347-4f97-96cc-30f458db08d5 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:06.904644 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-789f3297-a347-4f97-96cc-30f458db08d5 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:06.911351 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-789f3297-a347-4f97-96cc-30f458db08d5 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:06.912032 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-789f3297-a347-4f97-96cc-30f458db08d5 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:06.914004 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-789f3297-a347-4f97-96cc-30f458db08d5 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:06.914491 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-789f3297-a347-4f97-96cc-30f458db08d5 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:07.061356 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-789f3297-a347-4f97-96cc-30f458db08d5 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af02cd6ffd0484c8f6569629cd6313c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31cd38d46643fbac516d21ee4f89ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:07.071230 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-789f3297-a347-4f97-96cc-30f458db08d5 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b" status: 200 len: 1357 microversion: 2.1 time: 0.171779 Jun 07 22:06:07.071997 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 237/500] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:06 2022] GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b => generated 1357 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:07.730817 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-e8fe0fb2-71f8-4a67-a629-e7480a69167f tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:07.731455 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-e8fe0fb2-71f8-4a67-a629-e7480a69167f tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 51fd7e4e-4aea-426f-ae93-cd9dde475a9b] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:07.738031 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e8fe0fb2-71f8-4a67-a629-e7480a69167f tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:07.738512 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e8fe0fb2-71f8-4a67-a629-e7480a69167f tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:07.739262 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e8fe0fb2-71f8-4a67-a629-e7480a69167f tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:07.739722 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e8fe0fb2-71f8-4a67-a629-e7480a69167f tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:07.884239 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-e8fe0fb2-71f8-4a67-a629-e7480a69167f tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce9ec4aea9449d3890f6dbb93f97968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc558dd3848d4d3d950d7cd408e19741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:07.892785 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-e8fe0fb2-71f8-4a67-a629-e7480a69167f tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b" status: 200 len: 1313 microversion: 2.1 time: 0.165753 Jun 07 22:06:07.893614 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 264/501] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:07 2022] GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:06:08.088317 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-bf692e08-e468-4480-9f01-7e551f3f9dbc tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:08.088882 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-bf692e08-e468-4480-9f01-7e551f3f9dbc tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:08.094894 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-bf692e08-e468-4480-9f01-7e551f3f9dbc tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:08.095380 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-bf692e08-e468-4480-9f01-7e551f3f9dbc tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:08.096141 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-bf692e08-e468-4480-9f01-7e551f3f9dbc tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:08.096569 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-bf692e08-e468-4480-9f01-7e551f3f9dbc tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:08.478952 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-bf692e08-e468-4480-9f01-7e551f3f9dbc tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af02cd6ffd0484c8f6569629cd6313c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31cd38d46643fbac516d21ee4f89ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:08.486886 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-bf692e08-e468-4480-9f01-7e551f3f9dbc tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b" status: 200 len: 1357 microversion: 2.1 time: 0.402699 Jun 07 22:06:08.487480 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 238/502] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:08 2022] GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b => generated 1357 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:08.909987 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-01ac7b49-1694-4010-b97a-f43df69d6183 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:08.910575 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-01ac7b49-1694-4010-b97a-f43df69d6183 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 51fd7e4e-4aea-426f-ae93-cd9dde475a9b] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:08.917397 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-01ac7b49-1694-4010-b97a-f43df69d6183 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:08.917844 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-01ac7b49-1694-4010-b97a-f43df69d6183 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:08.918600 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-01ac7b49-1694-4010-b97a-f43df69d6183 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:08.919031 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-01ac7b49-1694-4010-b97a-f43df69d6183 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:09.058026 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-01ac7b49-1694-4010-b97a-f43df69d6183 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce9ec4aea9449d3890f6dbb93f97968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc558dd3848d4d3d950d7cd408e19741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:09.065569 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-01ac7b49-1694-4010-b97a-f43df69d6183 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b" status: 200 len: 1313 microversion: 2.1 time: 0.159453 Jun 07 22:06:09.066126 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 265/503] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:08 2022] GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:09.503877 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-391d35e4-dcca-40b7-aa5a-567514f0a1fe tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:09.504474 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-391d35e4-dcca-40b7-aa5a-567514f0a1fe tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:09.511495 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-391d35e4-dcca-40b7-aa5a-567514f0a1fe tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:09.512221 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-391d35e4-dcca-40b7-aa5a-567514f0a1fe tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:09.513192 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-391d35e4-dcca-40b7-aa5a-567514f0a1fe tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:09.513811 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-391d35e4-dcca-40b7-aa5a-567514f0a1fe tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:09.661243 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-391d35e4-dcca-40b7-aa5a-567514f0a1fe tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af02cd6ffd0484c8f6569629cd6313c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31cd38d46643fbac516d21ee4f89ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:09.669211 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-391d35e4-dcca-40b7-aa5a-567514f0a1fe tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b" status: 200 len: 1357 microversion: 2.1 time: 0.169097 Jun 07 22:06:09.669974 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 239/504] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:09 2022] GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b => generated 1357 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:10.081791 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-d2f3151e-590c-41d7-8d53-6cb94f351ff0 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:10.082427 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-d2f3151e-590c-41d7-8d53-6cb94f351ff0 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 51fd7e4e-4aea-426f-ae93-cd9dde475a9b] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:10.089021 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-d2f3151e-590c-41d7-8d53-6cb94f351ff0 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:10.089468 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-d2f3151e-590c-41d7-8d53-6cb94f351ff0 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:10.090218 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-d2f3151e-590c-41d7-8d53-6cb94f351ff0 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:10.090652 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-d2f3151e-590c-41d7-8d53-6cb94f351ff0 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:10.218341 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-d2f3151e-590c-41d7-8d53-6cb94f351ff0 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce9ec4aea9449d3890f6dbb93f97968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc558dd3848d4d3d950d7cd408e19741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:10.229219 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-d2f3151e-590c-41d7-8d53-6cb94f351ff0 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b" status: 200 len: 1313 microversion: 2.1 time: 0.151027 Jun 07 22:06:10.239409 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 266/505] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:10 2022] GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:10.685819 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-a6924921-6fb8-44b2-b586-25859a3abc86 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:10.686446 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-a6924921-6fb8-44b2-b586-25859a3abc86 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:10.692501 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a6924921-6fb8-44b2-b586-25859a3abc86 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:10.692944 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a6924921-6fb8-44b2-b586-25859a3abc86 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:10.694347 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a6924921-6fb8-44b2-b586-25859a3abc86 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:10.694786 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a6924921-6fb8-44b2-b586-25859a3abc86 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:10.828161 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-a6924921-6fb8-44b2-b586-25859a3abc86 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af02cd6ffd0484c8f6569629cd6313c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31cd38d46643fbac516d21ee4f89ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:10.835713 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-a6924921-6fb8-44b2-b586-25859a3abc86 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b" status: 200 len: 1357 microversion: 2.1 time: 0.153726 Jun 07 22:06:10.836278 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 240/506] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:10 2022] GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:11.247907 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-641e9547-3e3f-423f-b202-f7a439d4d5c3 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:11.248579 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-641e9547-3e3f-423f-b202-f7a439d4d5c3 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 51fd7e4e-4aea-426f-ae93-cd9dde475a9b] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:11.255614 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-641e9547-3e3f-423f-b202-f7a439d4d5c3 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:11.256084 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-641e9547-3e3f-423f-b202-f7a439d4d5c3 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:11.257194 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-641e9547-3e3f-423f-b202-f7a439d4d5c3 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:11.257321 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-641e9547-3e3f-423f-b202-f7a439d4d5c3 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:11.392192 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-641e9547-3e3f-423f-b202-f7a439d4d5c3 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce9ec4aea9449d3890f6dbb93f97968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc558dd3848d4d3d950d7cd408e19741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:11.399757 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-641e9547-3e3f-423f-b202-f7a439d4d5c3 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b" status: 200 len: 1313 microversion: 2.1 time: 0.156375 Jun 07 22:06:11.400338 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 267/507] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:11 2022] GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:11.852349 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-0e62cd43-e55e-45d7-acc2-68a76d9b9136 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:11.852959 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-0e62cd43-e55e-45d7-acc2-68a76d9b9136 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:11.860291 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0e62cd43-e55e-45d7-acc2-68a76d9b9136 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:11.861110 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0e62cd43-e55e-45d7-acc2-68a76d9b9136 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:11.867320 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0e62cd43-e55e-45d7-acc2-68a76d9b9136 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:11.868004 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0e62cd43-e55e-45d7-acc2-68a76d9b9136 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:12.019281 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-0e62cd43-e55e-45d7-acc2-68a76d9b9136 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af02cd6ffd0484c8f6569629cd6313c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31cd38d46643fbac516d21ee4f89ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:12.027653 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-0e62cd43-e55e-45d7-acc2-68a76d9b9136 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b" status: 200 len: 1357 microversion: 2.1 time: 0.179433 Jun 07 22:06:12.037410 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 241/508] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:11 2022] GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b => generated 1357 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:12.416652 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-a7e5c289-ac87-4adc-a6e2-70f562ce32c9 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:12.417229 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-a7e5c289-ac87-4adc-a6e2-70f562ce32c9 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 51fd7e4e-4aea-426f-ae93-cd9dde475a9b] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:12.423875 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a7e5c289-ac87-4adc-a6e2-70f562ce32c9 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:12.424314 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a7e5c289-ac87-4adc-a6e2-70f562ce32c9 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:12.425102 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a7e5c289-ac87-4adc-a6e2-70f562ce32c9 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:12.425535 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a7e5c289-ac87-4adc-a6e2-70f562ce32c9 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:12.564689 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-a7e5c289-ac87-4adc-a6e2-70f562ce32c9 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce9ec4aea9449d3890f6dbb93f97968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc558dd3848d4d3d950d7cd408e19741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:12.573242 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-a7e5c289-ac87-4adc-a6e2-70f562ce32c9 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b" status: 200 len: 1313 microversion: 2.1 time: 0.160454 Jun 07 22:06:12.574342 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 268/509] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:12 2022] GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:13.045478 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-18101353-1580-4936-9416-0dc3d04f1df7 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:13.046088 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-18101353-1580-4936-9416-0dc3d04f1df7 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:13.047965 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=1 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:06:13.054812 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-18101353-1580-4936-9416-0dc3d04f1df7 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:13.055255 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-18101353-1580-4936-9416-0dc3d04f1df7 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:13.056036 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-18101353-1580-4936-9416-0dc3d04f1df7 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:13.056467 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-18101353-1580-4936-9416-0dc3d04f1df7 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:13.187489 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-18101353-1580-4936-9416-0dc3d04f1df7 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af02cd6ffd0484c8f6569629cd6313c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31cd38d46643fbac516d21ee4f89ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:13.196336 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-18101353-1580-4936-9416-0dc3d04f1df7 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b" status: 200 len: 1357 microversion: 2.1 time: 0.154786 Jun 07 22:06:13.197103 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 242/510] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:13 2022] GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:06:13.216017 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-83e2a90f-52e1-4bc3-a390-50a9a7505df8 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Action: 'create', calling method: .version_select at 0x7f92f1ff0ee0>, body: {"keypair": {"name": "tempest-keypair-229823501", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBDeVMyEbyTcdy17Cy5/Bv8/jp1FI0NXjF7gBSBGlMDEqN6q2SFtdZEGhmovE1yhlLwAsPgX1l9xKs92uAmUj4qrYuojuxnkJvRtAjYp46fERBaYFGXxHheozYAXH+lIOQ=="}} {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:06:13.230588 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.quota [None req-83e2a90f-52e1-4bc3-a390-50a9a7505df8 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Getting quotas for project 0a4fc48a5efe4d8b974757a5bf7d947e. Resources: {'key_pairs'} {{(pid=117971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 22:06:13.234359 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.quota [None req-83e2a90f-52e1-4bc3-a390-50a9a7505df8 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Getting quotas for user c44c1788959e4b339c9cd5aad4318496 and project 0a4fc48a5efe4d8b974757a5bf7d947e. Resources: {'key_pairs'} {{(pid=117971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 22:06:13.257036 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-83e2a90f-52e1-4bc3-a390-50a9a7505df8 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.044822 Jun 07 22:06:13.262687 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 269/511] 10.222.0.13 () {60 vars in 1158 bytes} [Tue Jun 7 22:06:13 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:06:13.591710 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-2cd15c96-3f5c-41fa-ad0f-95c03bfe5d2e tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:13.592696 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-2cd15c96-3f5c-41fa-ad0f-95c03bfe5d2e tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 51fd7e4e-4aea-426f-ae93-cd9dde475a9b] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:13.601412 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-2cd15c96-3f5c-41fa-ad0f-95c03bfe5d2e tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:13.602286 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-2cd15c96-3f5c-41fa-ad0f-95c03bfe5d2e tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:13.603789 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-2cd15c96-3f5c-41fa-ad0f-95c03bfe5d2e tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:13.604665 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-2cd15c96-3f5c-41fa-ad0f-95c03bfe5d2e tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:13.772890 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-2cd15c96-3f5c-41fa-ad0f-95c03bfe5d2e tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce9ec4aea9449d3890f6dbb93f97968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc558dd3848d4d3d950d7cd408e19741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:13.782352 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-2cd15c96-3f5c-41fa-ad0f-95c03bfe5d2e tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b" status: 200 len: 1313 microversion: 2.1 time: 0.195268 Jun 07 22:06:13.782945 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 243/512] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:13 2022] GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b => generated 1313 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:14.214804 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-4b52bcc4-6263-4114-915f-e531db7b4cf4 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:14.215460 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-4b52bcc4-6263-4114-915f-e531db7b4cf4 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:14.223128 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-4b52bcc4-6263-4114-915f-e531db7b4cf4 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:14.223768 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-4b52bcc4-6263-4114-915f-e531db7b4cf4 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:14.224865 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-4b52bcc4-6263-4114-915f-e531db7b4cf4 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:14.226734 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-4b52bcc4-6263-4114-915f-e531db7b4cf4 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:14.423566 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-4b52bcc4-6263-4114-915f-e531db7b4cf4 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af02cd6ffd0484c8f6569629cd6313c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31cd38d46643fbac516d21ee4f89ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:14.447212 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-4b52bcc4-6263-4114-915f-e531db7b4cf4 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b" status: 200 len: 1357 microversion: 2.1 time: 0.237836 Jun 07 22:06:14.447912 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 270/513] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:14 2022] GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b => generated 1357 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:14.803281 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-37a4e9e3-140f-4b2b-9d56-da7f6806cce7 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1869407955", "imageRef": "87e2e140-6de8-4531-9681-d0a3e069622d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7ce3c4b5-2104-47b7-8f97-31211d4fa728"}], "security_groups": [{"name": "tempest-securitygroup--536746911"}], "key_name": "tempest-keypair-229823501", "user_data": "}} {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:06:14.803919 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-f3dbc88e-ba94-40a8-b5b2-bf8893bd5023 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:14.803919 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-f3dbc88e-ba94-40a8-b5b2-bf8893bd5023 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 51fd7e4e-4aea-426f-ae93-cd9dde475a9b] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:14.814198 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-f3dbc88e-ba94-40a8-b5b2-bf8893bd5023 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:14.814198 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-f3dbc88e-ba94-40a8-b5b2-bf8893bd5023 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:14.814198 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-f3dbc88e-ba94-40a8-b5b2-bf8893bd5023 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:14.814198 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-f3dbc88e-ba94-40a8-b5b2-bf8893bd5023 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:14.910298 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.network.neutron [None req-37a4e9e3-140f-4b2b-9d56-da7f6806cce7 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] validate_networks() for [('7ce3c4b5-2104-47b7-8f97-31211d4fa728', None, None, None, None, None)] {{(pid=117970) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 22:06:14.980222 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-f3dbc88e-ba94-40a8-b5b2-bf8893bd5023 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce9ec4aea9449d3890f6dbb93f97968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc558dd3848d4d3d950d7cd408e19741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:14.987627 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-f3dbc88e-ba94-40a8-b5b2-bf8893bd5023 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b" status: 200 len: 1313 microversion: 2.1 time: 0.191063 Jun 07 22:06:14.988206 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 271/514] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:14 2022] GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b => generated 1313 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:15.138575 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-b1b14492-9e17-48bf-81a8-ca0a0b8c94b9 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:15.139172 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-b1b14492-9e17-48bf-81a8-ca0a0b8c94b9 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] [instance: 8f7f3be8-21d5-446e-9ee5-0caa7c97a68a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:15.145677 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b1b14492-9e17-48bf-81a8-ca0a0b8c94b9 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:15.146259 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b1b14492-9e17-48bf-81a8-ca0a0b8c94b9 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:15.147151 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b1b14492-9e17-48bf-81a8-ca0a0b8c94b9 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:15.147669 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b1b14492-9e17-48bf-81a8-ca0a0b8c94b9 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:15.309646 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.objects.instance [None req-b1b14492-9e17-48bf-81a8-ca0a0b8c94b9 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lazy-loading 'services' on Instance uuid 8f7f3be8-21d5-446e-9ee5-0caa7c97a68a {{(pid=117971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 22:06:15.357116 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.virt.hardware [None req-37a4e9e3-140f-4b2b-9d56-da7f6806cce7 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Flavor limits 0:0:0 {{(pid=117970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 22:06:15.357594 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.virt.hardware [None req-37a4e9e3-140f-4b2b-9d56-da7f6806cce7 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Image limits 0:0:0 {{(pid=117970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 22:06:15.358059 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.virt.hardware [None req-37a4e9e3-140f-4b2b-9d56-da7f6806cce7 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Flavor pref 0:0:0 {{(pid=117970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 22:06:15.358480 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.virt.hardware [None req-37a4e9e3-140f-4b2b-9d56-da7f6806cce7 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Image pref 0:0:0 {{(pid=117970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 22:06:15.358885 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.virt.hardware [None req-37a4e9e3-140f-4b2b-9d56-da7f6806cce7 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 22:06:15.368629 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-37a4e9e3-140f-4b2b-9d56-da7f6806cce7 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:15.369001 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-37a4e9e3-140f-4b2b-9d56-da7f6806cce7 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:15.369912 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-37a4e9e3-140f-4b2b-9d56-da7f6806cce7 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:15.370610 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-37a4e9e3-140f-4b2b-9d56-da7f6806cce7 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:15.390517 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.quota [None req-37a4e9e3-140f-4b2b-9d56-da7f6806cce7 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Getting quotas for project 0a4fc48a5efe4d8b974757a5bf7d947e. Resources: {'cores', 'ram', 'instances'} {{(pid=117970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 22:06:15.394999 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.quota [None req-37a4e9e3-140f-4b2b-9d56-da7f6806cce7 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Getting quotas for user c44c1788959e4b339c9cd5aad4318496 and project 0a4fc48a5efe4d8b974757a5bf7d947e. Resources: {'cores', 'ram', 'instances'} {{(pid=117970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 22:06:15.413819 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-37a4e9e3-140f-4b2b-9d56-da7f6806cce7 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Going to run 1 instances... {{(pid=117970) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 22:06:15.416347 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-37a4e9e3-140f-4b2b-9d56-da7f6806cce7 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: f84b4686-8e5c-49af-b5ad-13f37e20f976] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='87e2e140-6de8-4531-9681-d0a3e069622d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 22:06:15.454856 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-b1b14492-9e17-48bf-81a8-ca0a0b8c94b9 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] 10.222.0.13 "DELETE /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a/os-volume_attachments/ed129da9-f353-4d84-84fb-e36bd8ae0a3e" status: 202 len: 0 microversion: 2.1 time: 0.319984 Jun 07 22:06:15.460595 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 272/515] 10.222.0.13 () {58 vars in 1415 bytes} [Tue Jun 7 22:06:15 2022] DELETE /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a/os-volume_attachments/ed129da9-f353-4d84-84fb-e36bd8ae0a3e => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 07 22:06:15.466582 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-d715faf0-7aee-44af-8e8e-0a983264fba1 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:15.468195 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-d715faf0-7aee-44af-8e8e-0a983264fba1 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:15.478109 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-d715faf0-7aee-44af-8e8e-0a983264fba1 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:15.478864 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-d715faf0-7aee-44af-8e8e-0a983264fba1 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:15.481028 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-37a4e9e3-140f-4b2b-9d56-da7f6806cce7 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.685930 Jun 07 22:06:15.482228 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 244/516] 10.222.0.13 () {60 vars in 1146 bytes} [Tue Jun 7 22:06:14 2022] POST /compute/v2.1/servers => generated 408 bytes in 688 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 22:06:15.492406 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-d715faf0-7aee-44af-8e8e-0a983264fba1 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:15.492940 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-d715faf0-7aee-44af-8e8e-0a983264fba1 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:15.494193 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-cf2acd20-44db-46e4-a90b-c9ea644577c5 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:15.495242 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-cf2acd20-44db-46e4-a90b-c9ea644577c5 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: f84b4686-8e5c-49af-b5ad-13f37e20f976] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:15.598437 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-cf2acd20-44db-46e4-a90b-c9ea644577c5 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:15.606648 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-cf2acd20-44db-46e4-a90b-c9ea644577c5 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976" status: 200 len: 1245 microversion: 2.1 time: 0.117883 Jun 07 22:06:15.608248 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 245/517] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:15 2022] GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976 => generated 1245 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:15.686074 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-d715faf0-7aee-44af-8e8e-0a983264fba1 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af02cd6ffd0484c8f6569629cd6313c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31cd38d46643fbac516d21ee4f89ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:15.693817 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-d715faf0-7aee-44af-8e8e-0a983264fba1 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b" status: 200 len: 1357 microversion: 2.1 time: 0.231456 Jun 07 22:06:15.695364 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 273/518] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:15 2022] GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b => generated 1357 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:16.006940 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-17c8e38e-ad12-400c-b219-56aa7cb7fa8f tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:16.007578 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-17c8e38e-ad12-400c-b219-56aa7cb7fa8f tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 51fd7e4e-4aea-426f-ae93-cd9dde475a9b] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:16.014570 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-17c8e38e-ad12-400c-b219-56aa7cb7fa8f tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:16.015015 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-17c8e38e-ad12-400c-b219-56aa7cb7fa8f tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:16.015808 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-17c8e38e-ad12-400c-b219-56aa7cb7fa8f tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:16.016240 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-17c8e38e-ad12-400c-b219-56aa7cb7fa8f tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:16.153759 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-17c8e38e-ad12-400c-b219-56aa7cb7fa8f tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce9ec4aea9449d3890f6dbb93f97968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc558dd3848d4d3d950d7cd408e19741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:16.161655 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-17c8e38e-ad12-400c-b219-56aa7cb7fa8f tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b" status: 200 len: 1313 microversion: 2.1 time: 0.159357 Jun 07 22:06:16.163198 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 246/519] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:16 2022] GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:16.625737 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-f8413ea2-af40-4223-9f25-42862666d3d5 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:16.626543 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-f8413ea2-af40-4223-9f25-42862666d3d5 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: f84b4686-8e5c-49af-b5ad-13f37e20f976] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:16.629034 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:06:16.635966 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-f8413ea2-af40-4223-9f25-42862666d3d5 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:16.636415 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-f8413ea2-af40-4223-9f25-42862666d3d5 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:16.637194 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-f8413ea2-af40-4223-9f25-42862666d3d5 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:16.637631 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-f8413ea2-af40-4223-9f25-42862666d3d5 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:16.658163 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:06:16.704620 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-f8413ea2-af40-4223-9f25-42862666d3d5 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:16.710998 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-8b052b0b-1225-4026-bc51-ddfc061f3892 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:16.711635 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-8b052b0b-1225-4026-bc51-ddfc061f3892 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:16.712327 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-f8413ea2-af40-4223-9f25-42862666d3d5 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976" status: 200 len: 1249 microversion: 2.1 time: 0.090505 Jun 07 22:06:16.712892 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 274/520] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:16 2022] GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976 => generated 1249 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:16.719523 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-8b052b0b-1225-4026-bc51-ddfc061f3892 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:16.719523 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-8b052b0b-1225-4026-bc51-ddfc061f3892 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:16.719523 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-8b052b0b-1225-4026-bc51-ddfc061f3892 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:16.719523 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-8b052b0b-1225-4026-bc51-ddfc061f3892 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:16.853036 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-8b052b0b-1225-4026-bc51-ddfc061f3892 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af02cd6ffd0484c8f6569629cd6313c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31cd38d46643fbac516d21ee4f89ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:16.860400 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-8b052b0b-1225-4026-bc51-ddfc061f3892 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b" status: 200 len: 1357 microversion: 2.1 time: 0.153477 Jun 07 22:06:16.860958 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 247/521] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:16 2022] GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:06:17.179094 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-bebc673a-ae08-4a09-916c-1c09e880ad45 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:17.179635 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-bebc673a-ae08-4a09-916c-1c09e880ad45 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 51fd7e4e-4aea-426f-ae93-cd9dde475a9b] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:17.185543 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-bebc673a-ae08-4a09-916c-1c09e880ad45 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:17.185981 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-bebc673a-ae08-4a09-916c-1c09e880ad45 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:17.186722 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-bebc673a-ae08-4a09-916c-1c09e880ad45 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:17.187150 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-bebc673a-ae08-4a09-916c-1c09e880ad45 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:17.322062 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-bebc673a-ae08-4a09-916c-1c09e880ad45 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce9ec4aea9449d3890f6dbb93f97968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc558dd3848d4d3d950d7cd408e19741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:17.331514 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-bebc673a-ae08-4a09-916c-1c09e880ad45 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b" status: 200 len: 1313 microversion: 2.1 time: 0.156731 Jun 07 22:06:17.332115 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 275/522] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:17 2022] GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:17.730311 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-96704d0a-1678-4e06-a702-339b0266347f tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:17.730895 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-96704d0a-1678-4e06-a702-339b0266347f tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: f84b4686-8e5c-49af-b5ad-13f37e20f976] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:17.736867 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-96704d0a-1678-4e06-a702-339b0266347f tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:17.737313 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-96704d0a-1678-4e06-a702-339b0266347f tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:17.738066 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-96704d0a-1678-4e06-a702-339b0266347f tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:17.738498 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-96704d0a-1678-4e06-a702-339b0266347f tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:17.753830 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_cell1:SELECT=100 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:06:17.799568 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-96704d0a-1678-4e06-a702-339b0266347f tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:17.812948 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-96704d0a-1678-4e06-a702-339b0266347f tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976" status: 200 len: 1249 microversion: 2.1 time: 0.086867 Jun 07 22:06:17.813528 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 248/523] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:17 2022] GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976 => generated 1249 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:17.877854 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-1617b032-db36-4327-a33c-ae7af118d9bd tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:17.878457 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-1617b032-db36-4327-a33c-ae7af118d9bd tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:17.885463 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-1617b032-db36-4327-a33c-ae7af118d9bd tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:17.885905 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-1617b032-db36-4327-a33c-ae7af118d9bd tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:17.886653 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-1617b032-db36-4327-a33c-ae7af118d9bd tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:17.887085 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-1617b032-db36-4327-a33c-ae7af118d9bd tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:18.014904 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-1617b032-db36-4327-a33c-ae7af118d9bd tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af02cd6ffd0484c8f6569629cd6313c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31cd38d46643fbac516d21ee4f89ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:18.022424 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-1617b032-db36-4327-a33c-ae7af118d9bd tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b" status: 200 len: 1357 microversion: 2.1 time: 0.148413 Jun 07 22:06:18.022979 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 276/524] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:17 2022] GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b => generated 1357 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:18.356254 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-882834a6-7670-42af-b6d1-f76db0120eab tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:18.356868 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-882834a6-7670-42af-b6d1-f76db0120eab tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 51fd7e4e-4aea-426f-ae93-cd9dde475a9b] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:18.362944 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-882834a6-7670-42af-b6d1-f76db0120eab tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:18.363409 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-882834a6-7670-42af-b6d1-f76db0120eab tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:18.364160 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-882834a6-7670-42af-b6d1-f76db0120eab tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:18.364586 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-882834a6-7670-42af-b6d1-f76db0120eab tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:18.497034 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-882834a6-7670-42af-b6d1-f76db0120eab tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce9ec4aea9449d3890f6dbb93f97968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc558dd3848d4d3d950d7cd408e19741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:18.504429 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-882834a6-7670-42af-b6d1-f76db0120eab tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b" status: 200 len: 1313 microversion: 2.1 time: 0.153366 Jun 07 22:06:18.504995 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 249/525] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:18 2022] GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:18.829932 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-54fa97c2-92e3-46d3-89a2-a5e5292434ba tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:18.830535 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-54fa97c2-92e3-46d3-89a2-a5e5292434ba tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: f84b4686-8e5c-49af-b5ad-13f37e20f976] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:18.837591 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-54fa97c2-92e3-46d3-89a2-a5e5292434ba tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:18.838037 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-54fa97c2-92e3-46d3-89a2-a5e5292434ba tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:18.838822 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-54fa97c2-92e3-46d3-89a2-a5e5292434ba tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:18.839255 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-54fa97c2-92e3-46d3-89a2-a5e5292434ba tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:18.899702 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-54fa97c2-92e3-46d3-89a2-a5e5292434ba tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:18.906992 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-54fa97c2-92e3-46d3-89a2-a5e5292434ba tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976" status: 200 len: 1249 microversion: 2.1 time: 0.080877 Jun 07 22:06:18.907584 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 277/526] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:18 2022] GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976 => generated 1249 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:19.039401 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-f30cf2ce-9925-463e-883f-5f7460bf2cf2 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:19.040041 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-f30cf2ce-9925-463e-883f-5f7460bf2cf2 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:19.045988 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f30cf2ce-9925-463e-883f-5f7460bf2cf2 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:19.046430 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f30cf2ce-9925-463e-883f-5f7460bf2cf2 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:19.047177 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f30cf2ce-9925-463e-883f-5f7460bf2cf2 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:19.047638 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f30cf2ce-9925-463e-883f-5f7460bf2cf2 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:19.172155 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-f30cf2ce-9925-463e-883f-5f7460bf2cf2 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af02cd6ffd0484c8f6569629cd6313c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31cd38d46643fbac516d21ee4f89ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:19.180128 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-f30cf2ce-9925-463e-883f-5f7460bf2cf2 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b" status: 200 len: 1357 microversion: 2.1 time: 0.145083 Jun 07 22:06:19.180688 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 250/527] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:19 2022] GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b => generated 1357 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:19.521272 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-566fe406-e70c-468e-bcd7-1b2a1ac96aa6 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:19.521784 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-566fe406-e70c-468e-bcd7-1b2a1ac96aa6 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 51fd7e4e-4aea-426f-ae93-cd9dde475a9b] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:19.527782 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-566fe406-e70c-468e-bcd7-1b2a1ac96aa6 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:19.528228 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-566fe406-e70c-468e-bcd7-1b2a1ac96aa6 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:19.528973 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-566fe406-e70c-468e-bcd7-1b2a1ac96aa6 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:19.529404 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-566fe406-e70c-468e-bcd7-1b2a1ac96aa6 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:19.658776 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-566fe406-e70c-468e-bcd7-1b2a1ac96aa6 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce9ec4aea9449d3890f6dbb93f97968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc558dd3848d4d3d950d7cd408e19741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:19.666668 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-566fe406-e70c-468e-bcd7-1b2a1ac96aa6 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b" status: 200 len: 1313 microversion: 2.1 time: 0.149277 Jun 07 22:06:19.667336 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 278/528] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:19 2022] GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:19.923772 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-ec12deaa-095e-4496-af5e-927c795ac3f2 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:19.924379 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-ec12deaa-095e-4496-af5e-927c795ac3f2 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: f84b4686-8e5c-49af-b5ad-13f37e20f976] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:19.930542 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-ec12deaa-095e-4496-af5e-927c795ac3f2 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:19.930983 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-ec12deaa-095e-4496-af5e-927c795ac3f2 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:19.931769 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-ec12deaa-095e-4496-af5e-927c795ac3f2 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:19.932199 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-ec12deaa-095e-4496-af5e-927c795ac3f2 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:19.991681 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-ec12deaa-095e-4496-af5e-927c795ac3f2 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:19.998888 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-ec12deaa-095e-4496-af5e-927c795ac3f2 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976" status: 200 len: 1249 microversion: 2.1 time: 0.078979 Jun 07 22:06:19.999465 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 251/529] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:19 2022] GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976 => generated 1249 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:20.197106 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-39c7b363-c858-4cca-96d3-ee00bbad34dc tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:20.197645 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-39c7b363-c858-4cca-96d3-ee00bbad34dc tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:20.204129 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-39c7b363-c858-4cca-96d3-ee00bbad34dc tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:20.204577 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-39c7b363-c858-4cca-96d3-ee00bbad34dc tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:20.205329 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-39c7b363-c858-4cca-96d3-ee00bbad34dc tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:20.205761 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-39c7b363-c858-4cca-96d3-ee00bbad34dc tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:20.337048 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-39c7b363-c858-4cca-96d3-ee00bbad34dc tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af02cd6ffd0484c8f6569629cd6313c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31cd38d46643fbac516d21ee4f89ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:20.344315 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-39c7b363-c858-4cca-96d3-ee00bbad34dc tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b" status: 200 len: 1357 microversion: 2.1 time: 0.151631 Jun 07 22:06:20.344871 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 279/530] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:20 2022] GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:20.683852 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-e0884d6a-bf5f-42d4-9c7c-4e0973cfa92e tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:20.684457 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-e0884d6a-bf5f-42d4-9c7c-4e0973cfa92e tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 51fd7e4e-4aea-426f-ae93-cd9dde475a9b] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:20.690469 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e0884d6a-bf5f-42d4-9c7c-4e0973cfa92e tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:20.690913 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e0884d6a-bf5f-42d4-9c7c-4e0973cfa92e tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:20.691692 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e0884d6a-bf5f-42d4-9c7c-4e0973cfa92e tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:20.692122 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e0884d6a-bf5f-42d4-9c7c-4e0973cfa92e tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:20.827549 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-e0884d6a-bf5f-42d4-9c7c-4e0973cfa92e tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce9ec4aea9449d3890f6dbb93f97968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc558dd3848d4d3d950d7cd408e19741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:20.835168 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-e0884d6a-bf5f-42d4-9c7c-4e0973cfa92e tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b" status: 200 len: 1313 microversion: 2.1 time: 0.154938 Jun 07 22:06:20.835822 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 252/531] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:20 2022] GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:21.015448 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-544d666c-df6d-4c3a-b181-5db05fc3fff6 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:21.015971 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-544d666c-df6d-4c3a-b181-5db05fc3fff6 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: f84b4686-8e5c-49af-b5ad-13f37e20f976] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:21.021937 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-544d666c-df6d-4c3a-b181-5db05fc3fff6 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:21.022369 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-544d666c-df6d-4c3a-b181-5db05fc3fff6 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:21.023106 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-544d666c-df6d-4c3a-b181-5db05fc3fff6 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:21.023556 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-544d666c-df6d-4c3a-b181-5db05fc3fff6 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:21.086276 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-544d666c-df6d-4c3a-b181-5db05fc3fff6 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:21.093771 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-544d666c-df6d-4c3a-b181-5db05fc3fff6 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976" status: 200 len: 1249 microversion: 2.1 time: 0.082196 Jun 07 22:06:21.094324 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 280/532] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:21 2022] GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976 => generated 1249 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:21.361679 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-5c08ae65-20a7-4d49-9896-2cc694d1a71a tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:21.362279 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-5c08ae65-20a7-4d49-9896-2cc694d1a71a tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:21.368419 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-5c08ae65-20a7-4d49-9896-2cc694d1a71a tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:21.368863 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-5c08ae65-20a7-4d49-9896-2cc694d1a71a tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:21.369603 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-5c08ae65-20a7-4d49-9896-2cc694d1a71a tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:21.370054 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-5c08ae65-20a7-4d49-9896-2cc694d1a71a tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:21.495840 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-5c08ae65-20a7-4d49-9896-2cc694d1a71a tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af02cd6ffd0484c8f6569629cd6313c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31cd38d46643fbac516d21ee4f89ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:21.503028 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-5c08ae65-20a7-4d49-9896-2cc694d1a71a tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b" status: 200 len: 1357 microversion: 2.1 time: 0.145313 Jun 07 22:06:21.503620 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 253/533] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:21 2022] GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b => generated 1357 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:21.854307 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-3f017548-eb09-4a4b-82f7-ed6f8cb7ce1b tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:21.855026 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-3f017548-eb09-4a4b-82f7-ed6f8cb7ce1b tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 51fd7e4e-4aea-426f-ae93-cd9dde475a9b] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:21.861475 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-3f017548-eb09-4a4b-82f7-ed6f8cb7ce1b tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:21.862185 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-3f017548-eb09-4a4b-82f7-ed6f8cb7ce1b tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:21.863571 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-3f017548-eb09-4a4b-82f7-ed6f8cb7ce1b tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:21.864179 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-3f017548-eb09-4a4b-82f7-ed6f8cb7ce1b tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:22.007408 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-3f017548-eb09-4a4b-82f7-ed6f8cb7ce1b tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce9ec4aea9449d3890f6dbb93f97968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc558dd3848d4d3d950d7cd408e19741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:22.015098 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-3f017548-eb09-4a4b-82f7-ed6f8cb7ce1b tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b" status: 200 len: 1313 microversion: 2.1 time: 0.166028 Jun 07 22:06:22.019491 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 281/534] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:21 2022] GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:22.111279 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-0dc1188f-4bf0-41fc-a30d-49c71ab6b4f6 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:22.111954 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-0dc1188f-4bf0-41fc-a30d-49c71ab6b4f6 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: f84b4686-8e5c-49af-b5ad-13f37e20f976] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:22.118707 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0dc1188f-4bf0-41fc-a30d-49c71ab6b4f6 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:22.119236 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0dc1188f-4bf0-41fc-a30d-49c71ab6b4f6 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:22.120153 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0dc1188f-4bf0-41fc-a30d-49c71ab6b4f6 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:22.120652 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0dc1188f-4bf0-41fc-a30d-49c71ab6b4f6 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:22.209153 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-0dc1188f-4bf0-41fc-a30d-49c71ab6b4f6 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:22.217021 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-0dc1188f-4bf0-41fc-a30d-49c71ab6b4f6 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976" status: 200 len: 1241 microversion: 2.1 time: 0.109626 Jun 07 22:06:22.217796 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 254/535] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:22 2022] GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976 => generated 1241 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:22.520553 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-802881aa-c95f-47c6-8fa6-58ac86601985 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:22.521117 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-802881aa-c95f-47c6-8fa6-58ac86601985 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:22.527775 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-802881aa-c95f-47c6-8fa6-58ac86601985 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:22.528221 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-802881aa-c95f-47c6-8fa6-58ac86601985 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:22.528969 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-802881aa-c95f-47c6-8fa6-58ac86601985 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:22.529557 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-802881aa-c95f-47c6-8fa6-58ac86601985 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:22.672620 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-802881aa-c95f-47c6-8fa6-58ac86601985 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af02cd6ffd0484c8f6569629cd6313c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31cd38d46643fbac516d21ee4f89ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:22.687645 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-802881aa-c95f-47c6-8fa6-58ac86601985 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b" status: 200 len: 1357 microversion: 2.1 time: 0.171003 Jun 07 22:06:22.691456 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 282/536] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:22 2022] GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b => generated 1357 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:22.733304 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [req-1ac03703-cba6-40ac-b246-fafea06114b4 req-d6337622-4437-44d6-a9bc-a11d6aea65a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbab64b0-0fb5-49d7-aeeb-d744856ddc2b", "tag": "93fff328-2cf7-4f1c-9e4e-23777eeb1a75"}]} {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:06:22.752803 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [req-1ac03703-cba6-40ac-b246-fafea06114b4 req-d6337622-4437-44d6-a9bc-a11d6aea65a4 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:22.756926 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [req-1ac03703-cba6-40ac-b246-fafea06114b4 req-d6337622-4437-44d6-a9bc-a11d6aea65a4 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:22.773692 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.compute.server_external_events [req-1ac03703-cba6-40ac-b246-fafea06114b4 req-d6337622-4437-44d6-a9bc-a11d6aea65a4 service nova] Creating event network-changed:93fff328-2cf7-4f1c-9e4e-23777eeb1a75 for instance fbab64b0-0fb5-49d7-aeeb-d744856ddc2b on hv-cinder-83552 Jun 07 22:06:22.779513 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [req-1ac03703-cba6-40ac-b246-fafea06114b4 req-d6337622-4437-44d6-a9bc-a11d6aea65a4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050107 Jun 07 22:06:22.781072 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 255/537] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:06:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:06:23.031908 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-119c7170-f7d8-4e55-8975-b92d2de42515 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:23.032478 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-119c7170-f7d8-4e55-8975-b92d2de42515 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 51fd7e4e-4aea-426f-ae93-cd9dde475a9b] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:23.039744 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-119c7170-f7d8-4e55-8975-b92d2de42515 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:23.040196 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-119c7170-f7d8-4e55-8975-b92d2de42515 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:23.040954 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-119c7170-f7d8-4e55-8975-b92d2de42515 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:23.041393 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-119c7170-f7d8-4e55-8975-b92d2de42515 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:23.174387 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-119c7170-f7d8-4e55-8975-b92d2de42515 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce9ec4aea9449d3890f6dbb93f97968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc558dd3848d4d3d950d7cd408e19741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:23.182063 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-119c7170-f7d8-4e55-8975-b92d2de42515 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b" status: 200 len: 1313 microversion: 2.1 time: 0.154124 Jun 07 22:06:23.182626 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 283/538] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:23 2022] GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:23.235140 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-97434e92-7851-457b-965b-2fb2e8946be8 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:23.235884 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-97434e92-7851-457b-965b-2fb2e8946be8 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: f84b4686-8e5c-49af-b5ad-13f37e20f976] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:23.244003 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-97434e92-7851-457b-965b-2fb2e8946be8 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:23.244447 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-97434e92-7851-457b-965b-2fb2e8946be8 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:23.245222 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-97434e92-7851-457b-965b-2fb2e8946be8 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:23.245654 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-97434e92-7851-457b-965b-2fb2e8946be8 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:23.313852 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-97434e92-7851-457b-965b-2fb2e8946be8 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:23.322158 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-97434e92-7851-457b-965b-2fb2e8946be8 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976" status: 200 len: 1297 microversion: 2.1 time: 0.091424 Jun 07 22:06:23.322722 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 256/539] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:23 2022] GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976 => generated 1297 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:23.704894 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-e8ab173e-9936-4c71-8970-ef17c5fc7ee5 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:23.705604 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-e8ab173e-9936-4c71-8970-ef17c5fc7ee5 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:23.712092 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_cell0:SELECT=4 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:06:23.719820 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e8ab173e-9936-4c71-8970-ef17c5fc7ee5 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:23.720493 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e8ab173e-9936-4c71-8970-ef17c5fc7ee5 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:23.721281 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e8ab173e-9936-4c71-8970-ef17c5fc7ee5 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:23.721719 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e8ab173e-9936-4c71-8970-ef17c5fc7ee5 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:23.860321 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-e8ab173e-9936-4c71-8970-ef17c5fc7ee5 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af02cd6ffd0484c8f6569629cd6313c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31cd38d46643fbac516d21ee4f89ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:23.868977 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-e8ab173e-9936-4c71-8970-ef17c5fc7ee5 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b" status: 200 len: 1357 microversion: 2.1 time: 0.168024 Jun 07 22:06:23.869466 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 284/540] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:23 2022] GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:24.001884 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-77fd579b-b85f-4851-a228-6dc51035615b tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:24.002705 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-77fd579b-b85f-4851-a228-6dc51035615b tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] [instance: 8f7f3be8-21d5-446e-9ee5-0caa7c97a68a] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:24.008984 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-77fd579b-b85f-4851-a228-6dc51035615b tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:24.009426 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-77fd579b-b85f-4851-a228-6dc51035615b tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:24.010292 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-77fd579b-b85f-4851-a228-6dc51035615b tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:24.010902 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-77fd579b-b85f-4851-a228-6dc51035615b tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:24.036266 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-77fd579b-b85f-4851-a228-6dc51035615b tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] [instance: 8f7f3be8-21d5-446e-9ee5-0caa7c97a68a] Going to try to terminate instance {{(pid=117970) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 22:06:24.135249 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-77fd579b-b85f-4851-a228-6dc51035615b tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] 10.222.0.13 "DELETE /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a" status: 204 len: 0 microversion: 2.1 time: 0.137189 Jun 07 22:06:24.138933 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 257/541] 10.222.0.13 () {58 vars in 1238 bytes} [Tue Jun 7 22:06:23 2022] DELETE /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 22:06:24.144798 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-1cbdf27a-9ff4-4002-a5e0-afd253b74f32 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:24.146105 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-1cbdf27a-9ff4-4002-a5e0-afd253b74f32 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] [instance: 8f7f3be8-21d5-446e-9ee5-0caa7c97a68a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:24.153822 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-1cbdf27a-9ff4-4002-a5e0-afd253b74f32 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:24.154264 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-1cbdf27a-9ff4-4002-a5e0-afd253b74f32 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:24.155211 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-1cbdf27a-9ff4-4002-a5e0-afd253b74f32 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:24.155668 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-1cbdf27a-9ff4-4002-a5e0-afd253b74f32 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:24.200313 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-4f9e416c-68f4-4d74-a23b-6e30e8c07dfd tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:24.201051 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-4f9e416c-68f4-4d74-a23b-6e30e8c07dfd tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 51fd7e4e-4aea-426f-ae93-cd9dde475a9b] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:24.209881 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4f9e416c-68f4-4d74-a23b-6e30e8c07dfd tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:24.210398 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4f9e416c-68f4-4d74-a23b-6e30e8c07dfd tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:24.211222 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4f9e416c-68f4-4d74-a23b-6e30e8c07dfd tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:24.212280 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4f9e416c-68f4-4d74-a23b-6e30e8c07dfd tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:24.348876 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-4f9e416c-68f4-4d74-a23b-6e30e8c07dfd tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce9ec4aea9449d3890f6dbb93f97968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc558dd3848d4d3d950d7cd408e19741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:24.360103 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-4f9e416c-68f4-4d74-a23b-6e30e8c07dfd tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b" status: 200 len: 1313 microversion: 2.1 time: 0.164206 Jun 07 22:06:24.360691 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 258/542] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:24 2022] GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:06:24.374318 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-60cd88a9-5d99-45d3-8d53-ffd89e0c261d tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:24.374922 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-60cd88a9-5d99-45d3-8d53-ffd89e0c261d tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: f84b4686-8e5c-49af-b5ad-13f37e20f976] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:24.380959 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-60cd88a9-5d99-45d3-8d53-ffd89e0c261d tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:24.381408 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-60cd88a9-5d99-45d3-8d53-ffd89e0c261d tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:24.382173 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-60cd88a9-5d99-45d3-8d53-ffd89e0c261d tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:24.382617 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-60cd88a9-5d99-45d3-8d53-ffd89e0c261d tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:24.401921 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-1cbdf27a-9ff4-4002-a5e0-afd253b74f32 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4fc7744b3d4e5fb6e281fcc90cef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b84dd581fc4e9499cfecbb7242e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:24.410151 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-1cbdf27a-9ff4-4002-a5e0-afd253b74f32 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] 10.222.0.13 "GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a" status: 200 len: 1513 microversion: 2.1 time: 0.269163 Jun 07 22:06:24.410767 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 285/543] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:24 2022] GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a => generated 1513 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:24.537723 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-60cd88a9-5d99-45d3-8d53-ffd89e0c261d tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:24.549214 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-60cd88a9-5d99-45d3-8d53-ffd89e0c261d tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976" status: 200 len: 1370 microversion: 2.1 time: 0.174858 Jun 07 22:06:24.550404 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 259/544] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:24 2022] GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976 => generated 1370 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:24.885742 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-8a55bf37-40b5-43a5-9fc7-d23ca991669f tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:24.886344 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-8a55bf37-40b5-43a5-9fc7-d23ca991669f tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:24.892378 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-8a55bf37-40b5-43a5-9fc7-d23ca991669f tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:24.892812 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-8a55bf37-40b5-43a5-9fc7-d23ca991669f tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:24.893556 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-8a55bf37-40b5-43a5-9fc7-d23ca991669f tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:24.893980 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-8a55bf37-40b5-43a5-9fc7-d23ca991669f tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:25.021192 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-8a55bf37-40b5-43a5-9fc7-d23ca991669f tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af02cd6ffd0484c8f6569629cd6313c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31cd38d46643fbac516d21ee4f89ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:25.029110 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-8a55bf37-40b5-43a5-9fc7-d23ca991669f tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b" status: 200 len: 1357 microversion: 2.1 time: 0.147982 Jun 07 22:06:25.029673 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 286/545] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:24 2022] GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b => generated 1357 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:25.376613 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-a83e01d0-9fde-4efc-be76-91547d1283a1 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:25.377215 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-a83e01d0-9fde-4efc-be76-91547d1283a1 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 51fd7e4e-4aea-426f-ae93-cd9dde475a9b] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:25.379155 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_cell0:SELECT=2 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:06:25.385386 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a83e01d0-9fde-4efc-be76-91547d1283a1 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:25.385823 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a83e01d0-9fde-4efc-be76-91547d1283a1 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:25.386582 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a83e01d0-9fde-4efc-be76-91547d1283a1 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:25.386992 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a83e01d0-9fde-4efc-be76-91547d1283a1 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:25.430178 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-56f679dc-28d3-4311-aaa5-e9abdc29728a tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:25.430893 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-56f679dc-28d3-4311-aaa5-e9abdc29728a tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] [instance: 8f7f3be8-21d5-446e-9ee5-0caa7c97a68a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:25.437397 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-56f679dc-28d3-4311-aaa5-e9abdc29728a tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:25.437943 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-56f679dc-28d3-4311-aaa5-e9abdc29728a tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:25.438767 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-56f679dc-28d3-4311-aaa5-e9abdc29728a tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:25.439273 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-56f679dc-28d3-4311-aaa5-e9abdc29728a tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:25.515922 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-a83e01d0-9fde-4efc-be76-91547d1283a1 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce9ec4aea9449d3890f6dbb93f97968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc558dd3848d4d3d950d7cd408e19741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:25.524283 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-a83e01d0-9fde-4efc-be76-91547d1283a1 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b" status: 200 len: 1313 microversion: 2.1 time: 0.151392 Jun 07 22:06:25.524853 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 260/546] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:25 2022] GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:25.567267 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-12254379-7be1-477a-b8c3-bd0dba813f7d tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:25.568121 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-12254379-7be1-477a-b8c3-bd0dba813f7d tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: f84b4686-8e5c-49af-b5ad-13f37e20f976] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:25.574274 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-12254379-7be1-477a-b8c3-bd0dba813f7d tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:25.574720 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-12254379-7be1-477a-b8c3-bd0dba813f7d tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:25.575519 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-12254379-7be1-477a-b8c3-bd0dba813f7d tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:25.575629 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-56f679dc-28d3-4311-aaa5-e9abdc29728a tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4fc7744b3d4e5fb6e281fcc90cef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b84dd581fc4e9499cfecbb7242e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:25.575956 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-12254379-7be1-477a-b8c3-bd0dba813f7d tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:25.583167 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-56f679dc-28d3-4311-aaa5-e9abdc29728a tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] 10.222.0.13 "GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a" status: 200 len: 1513 microversion: 2.1 time: 0.156948 Jun 07 22:06:25.584002 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 287/547] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:25 2022] GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:06:25.604250 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_cell0:SELECT=8 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:06:26.047202 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-7fe4f601-5bf5-48c5-924f-9e2ba6e075dc tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:26.047927 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-7fe4f601-5bf5-48c5-924f-9e2ba6e075dc tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:26.056683 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-7fe4f601-5bf5-48c5-924f-9e2ba6e075dc tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:26.058326 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-7fe4f601-5bf5-48c5-924f-9e2ba6e075dc tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:26.059481 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-7fe4f601-5bf5-48c5-924f-9e2ba6e075dc tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:26.060224 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-7fe4f601-5bf5-48c5-924f-9e2ba6e075dc tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:26.173841 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-12254379-7be1-477a-b8c3-bd0dba813f7d tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:26.182260 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-12254379-7be1-477a-b8c3-bd0dba813f7d tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976" status: 200 len: 1370 microversion: 2.1 time: 0.618769 Jun 07 22:06:26.182827 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 261/548] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:25 2022] GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976 => generated 1370 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:06:26.276170 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-7fe4f601-5bf5-48c5-924f-9e2ba6e075dc tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af02cd6ffd0484c8f6569629cd6313c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31cd38d46643fbac516d21ee4f89ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:26.283649 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-7fe4f601-5bf5-48c5-924f-9e2ba6e075dc tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b" status: 200 len: 1357 microversion: 2.1 time: 0.240427 Jun 07 22:06:26.284221 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 288/549] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:26 2022] GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b => generated 1357 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:26.546404 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-ba5c476d-40c2-4d28-bac6-d2eeb63f5557 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:26.547917 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-ba5c476d-40c2-4d28-bac6-d2eeb63f5557 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 51fd7e4e-4aea-426f-ae93-cd9dde475a9b] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:26.550957 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [req-461c7933-3904-49c1-b903-83ed654c99bd req-8a753698-40c4-4d56-8e63-2c77ee6c39c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f84b4686-8e5c-49af-b5ad-13f37e20f976", "tag": "3d9f0611-4530-459f-983c-a70170e27b7f"}]} {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:06:26.555692 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-ba5c476d-40c2-4d28-bac6-d2eeb63f5557 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:26.556334 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-ba5c476d-40c2-4d28-bac6-d2eeb63f5557 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:26.557145 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-ba5c476d-40c2-4d28-bac6-d2eeb63f5557 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:26.558191 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-ba5c476d-40c2-4d28-bac6-d2eeb63f5557 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:26.567608 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-461c7933-3904-49c1-b903-83ed654c99bd req-8a753698-40c4-4d56-8e63-2c77ee6c39c5 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:26.568978 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-461c7933-3904-49c1-b903-83ed654c99bd req-8a753698-40c4-4d56-8e63-2c77ee6c39c5 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:26.581374 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.compute.server_external_events [req-461c7933-3904-49c1-b903-83ed654c99bd req-8a753698-40c4-4d56-8e63-2c77ee6c39c5 service nova] Creating event network-changed:3d9f0611-4530-459f-983c-a70170e27b7f for instance f84b4686-8e5c-49af-b5ad-13f37e20f976 on hv-cinder-83552 Jun 07 22:06:26.586943 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [req-461c7933-3904-49c1-b903-83ed654c99bd req-8a753698-40c4-4d56-8e63-2c77ee6c39c5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041821 Jun 07 22:06:26.587751 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 289/550] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:06:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:06:26.601990 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-c8bdaa37-505b-4cb6-9d83-12634719e809 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:26.602677 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-c8bdaa37-505b-4cb6-9d83-12634719e809 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] [instance: 8f7f3be8-21d5-446e-9ee5-0caa7c97a68a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:26.610096 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c8bdaa37-505b-4cb6-9d83-12634719e809 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:26.611194 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c8bdaa37-505b-4cb6-9d83-12634719e809 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:26.611997 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c8bdaa37-505b-4cb6-9d83-12634719e809 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:26.612595 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c8bdaa37-505b-4cb6-9d83-12634719e809 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:26.727401 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-ba5c476d-40c2-4d28-bac6-d2eeb63f5557 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce9ec4aea9449d3890f6dbb93f97968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc558dd3848d4d3d950d7cd408e19741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:26.737072 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-ba5c476d-40c2-4d28-bac6-d2eeb63f5557 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b" status: 200 len: 1313 microversion: 2.1 time: 0.198262 Jun 07 22:06:26.737791 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 262/551] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:26 2022] GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b => generated 1313 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:26.759509 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-c8bdaa37-505b-4cb6-9d83-12634719e809 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4fc7744b3d4e5fb6e281fcc90cef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b84dd581fc4e9499cfecbb7242e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:26.768532 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-c8bdaa37-505b-4cb6-9d83-12634719e809 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] 10.222.0.13 "GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a" status: 200 len: 1513 microversion: 2.1 time: 0.171174 Jun 07 22:06:26.769101 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 290/552] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:26 2022] GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a => generated 1513 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:06:27.198227 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-9236372e-3a2a-4966-8e58-135c09c4332c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:27.198827 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-9236372e-3a2a-4966-8e58-135c09c4332c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: f84b4686-8e5c-49af-b5ad-13f37e20f976] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:27.204855 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-9236372e-3a2a-4966-8e58-135c09c4332c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:27.205301 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-9236372e-3a2a-4966-8e58-135c09c4332c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:27.206046 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-9236372e-3a2a-4966-8e58-135c09c4332c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:27.206478 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-9236372e-3a2a-4966-8e58-135c09c4332c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:27.299263 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-7e228794-4ef0-4f9d-a2e2-d0a61b18293a tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:27.299887 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-7e228794-4ef0-4f9d-a2e2-d0a61b18293a tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:27.306202 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-7e228794-4ef0-4f9d-a2e2-d0a61b18293a tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:27.306903 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-7e228794-4ef0-4f9d-a2e2-d0a61b18293a tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:27.307964 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-7e228794-4ef0-4f9d-a2e2-d0a61b18293a tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:27.308778 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-7e228794-4ef0-4f9d-a2e2-d0a61b18293a tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:27.338350 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-9236372e-3a2a-4966-8e58-135c09c4332c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:27.345751 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-9236372e-3a2a-4966-8e58-135c09c4332c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976" status: 200 len: 1370 microversion: 2.1 time: 0.151337 Jun 07 22:06:27.346315 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 263/553] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:27 2022] GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976 => generated 1370 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:27.439378 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-7e228794-4ef0-4f9d-a2e2-d0a61b18293a tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af02cd6ffd0484c8f6569629cd6313c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31cd38d46643fbac516d21ee4f89ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:27.442802 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_cell1:SELECT=100 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:06:27.448580 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-7e228794-4ef0-4f9d-a2e2-d0a61b18293a tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b" status: 200 len: 1357 microversion: 2.1 time: 0.153022 Jun 07 22:06:27.449134 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 291/554] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:27 2022] GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:06:27.754312 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-e2797090-6a55-498f-bab3-250f6b659750 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:27.754851 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-e2797090-6a55-498f-bab3-250f6b659750 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 51fd7e4e-4aea-426f-ae93-cd9dde475a9b] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:27.761570 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e2797090-6a55-498f-bab3-250f6b659750 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:27.762018 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e2797090-6a55-498f-bab3-250f6b659750 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:27.762912 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e2797090-6a55-498f-bab3-250f6b659750 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:27.763205 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e2797090-6a55-498f-bab3-250f6b659750 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:27.765813 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:06:27.785913 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-214ad179-6e25-4a8f-9bd3-886054535646 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:27.786548 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-214ad179-6e25-4a8f-9bd3-886054535646 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] [instance: 8f7f3be8-21d5-446e-9ee5-0caa7c97a68a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:27.792899 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-214ad179-6e25-4a8f-9bd3-886054535646 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:27.793346 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-214ad179-6e25-4a8f-9bd3-886054535646 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:27.794094 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-214ad179-6e25-4a8f-9bd3-886054535646 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:27.794523 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-214ad179-6e25-4a8f-9bd3-886054535646 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:27.898081 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-e2797090-6a55-498f-bab3-250f6b659750 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce9ec4aea9449d3890f6dbb93f97968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc558dd3848d4d3d950d7cd408e19741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:27.905475 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-e2797090-6a55-498f-bab3-250f6b659750 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b" status: 200 len: 1313 microversion: 2.1 time: 0.155045 Jun 07 22:06:27.906123 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 264/555] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:27 2022] GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:27.936596 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-214ad179-6e25-4a8f-9bd3-886054535646 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4fc7744b3d4e5fb6e281fcc90cef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b84dd581fc4e9499cfecbb7242e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:27.944631 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-214ad179-6e25-4a8f-9bd3-886054535646 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] 10.222.0.13 "GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a" status: 200 len: 1513 microversion: 2.1 time: 0.162294 Jun 07 22:06:27.945190 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 292/556] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:27 2022] GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a => generated 1513 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:06:28.363785 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-fe641a70-855e-4ec0-a1d3-8a1c629cb388 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:28.364395 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-fe641a70-855e-4ec0-a1d3-8a1c629cb388 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: f84b4686-8e5c-49af-b5ad-13f37e20f976] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:28.371211 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-fe641a70-855e-4ec0-a1d3-8a1c629cb388 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:28.371761 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-fe641a70-855e-4ec0-a1d3-8a1c629cb388 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:28.372438 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-fe641a70-855e-4ec0-a1d3-8a1c629cb388 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:28.372874 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-fe641a70-855e-4ec0-a1d3-8a1c629cb388 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:28.465050 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-cb4fd87c-d80c-488c-b313-4d6203022f02 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:28.465667 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-cb4fd87c-d80c-488c-b313-4d6203022f02 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:28.472788 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-cb4fd87c-d80c-488c-b313-4d6203022f02 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:28.473589 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-cb4fd87c-d80c-488c-b313-4d6203022f02 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:28.474840 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-cb4fd87c-d80c-488c-b313-4d6203022f02 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:28.475514 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-cb4fd87c-d80c-488c-b313-4d6203022f02 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:28.509214 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-fe641a70-855e-4ec0-a1d3-8a1c629cb388 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:28.516847 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-fe641a70-855e-4ec0-a1d3-8a1c629cb388 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976" status: 200 len: 1370 microversion: 2.1 time: 0.156926 Jun 07 22:06:28.517574 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 265/557] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:28 2022] GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976 => generated 1370 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:28.617773 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-cb4fd87c-d80c-488c-b313-4d6203022f02 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af02cd6ffd0484c8f6569629cd6313c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31cd38d46643fbac516d21ee4f89ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:28.625010 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-cb4fd87c-d80c-488c-b313-4d6203022f02 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b" status: 200 len: 1357 microversion: 2.1 time: 0.163840 Jun 07 22:06:28.625582 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 293/558] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:28 2022] GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:06:28.643274 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-a2da679b-af93-49f7-8108-844867485bc1 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1429031626", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1489617035", "security_groups": [{"name": "tempest-secgroup-smoke-1229564476"}], "block_device_mapping_v2": [{"uuid": "7ea35f9d-cc53-4afb-a9a1-bc965739f562", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "63aac617-2d3a-4d8b-b894-a27820a7e5e2"}]}} {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:06:28.755608 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.network.neutron [None req-a2da679b-af93-49f7-8108-844867485bc1 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] validate_networks() for [('63aac617-2d3a-4d8b-b894-a27820a7e5e2', None, None, None, None, None)] {{(pid=117970) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 22:06:28.922011 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-bb095bae-d1bb-4b76-baaf-9f195d4f49c4 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:28.922597 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-bb095bae-d1bb-4b76-baaf-9f195d4f49c4 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 51fd7e4e-4aea-426f-ae93-cd9dde475a9b] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:28.930255 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-bb095bae-d1bb-4b76-baaf-9f195d4f49c4 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:28.930697 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-bb095bae-d1bb-4b76-baaf-9f195d4f49c4 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:28.931504 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-bb095bae-d1bb-4b76-baaf-9f195d4f49c4 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:28.931948 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-bb095bae-d1bb-4b76-baaf-9f195d4f49c4 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:29.064542 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-bb095bae-d1bb-4b76-baaf-9f195d4f49c4 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce9ec4aea9449d3890f6dbb93f97968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc558dd3848d4d3d950d7cd408e19741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:29.072572 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-bb095bae-d1bb-4b76-baaf-9f195d4f49c4 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b" status: 200 len: 1313 microversion: 2.1 time: 0.154325 Jun 07 22:06:29.073238 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 294/559] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:28 2022] GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:06:29.079082 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-fa5ffd5f-834f-4679-9fa1-e86f1c158b9e tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:29.079893 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-fa5ffd5f-834f-4679-9fa1-e86f1c158b9e tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] [instance: 8f7f3be8-21d5-446e-9ee5-0caa7c97a68a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:29.086646 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-fa5ffd5f-834f-4679-9fa1-e86f1c158b9e tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:29.087087 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-fa5ffd5f-834f-4679-9fa1-e86f1c158b9e tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:29.088071 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-fa5ffd5f-834f-4679-9fa1-e86f1c158b9e tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:29.088284 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-fa5ffd5f-834f-4679-9fa1-e86f1c158b9e tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:29.134093 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.virt.hardware [None req-a2da679b-af93-49f7-8108-844867485bc1 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Flavor limits 0:0:0 {{(pid=117970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 22:06:29.134516 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.virt.hardware [None req-a2da679b-af93-49f7-8108-844867485bc1 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Image limits 0:0:0 {{(pid=117970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 22:06:29.134983 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.virt.hardware [None req-a2da679b-af93-49f7-8108-844867485bc1 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Flavor pref 0:0:0 {{(pid=117970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 22:06:29.135579 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.virt.hardware [None req-a2da679b-af93-49f7-8108-844867485bc1 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Image pref 0:0:0 {{(pid=117970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 22:06:29.136076 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.virt.hardware [None req-a2da679b-af93-49f7-8108-844867485bc1 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 22:06:29.145901 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a2da679b-af93-49f7-8108-844867485bc1 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:29.146349 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a2da679b-af93-49f7-8108-844867485bc1 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:29.147238 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a2da679b-af93-49f7-8108-844867485bc1 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:29.147829 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a2da679b-af93-49f7-8108-844867485bc1 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:29.164724 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.quota [None req-a2da679b-af93-49f7-8108-844867485bc1 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Getting quotas for project 579eb78d8af74e2cadce3a0c793b4440. Resources: {'cores', 'ram', 'instances'} {{(pid=117970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 22:06:29.168792 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.quota [None req-a2da679b-af93-49f7-8108-844867485bc1 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Getting quotas for user c710942802df49ec8bd630e4b225eed2 and project 579eb78d8af74e2cadce3a0c793b4440. Resources: {'cores', 'ram', 'instances'} {{(pid=117970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 22:06:29.225138 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-a2da679b-af93-49f7-8108-844867485bc1 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Going to run 1 instances... {{(pid=117970) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 22:06:29.227685 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-a2da679b-af93-49f7-8108-844867485bc1 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: c2ece8dd-91fb-472c-b0c7-970ee215412f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7ea35f9d-cc53-4afb-a9a1-bc965739f562',volume_size=None,volume_type=None)] {{(pid=117970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 22:06:29.229422 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-fa5ffd5f-834f-4679-9fa1-e86f1c158b9e tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4fc7744b3d4e5fb6e281fcc90cef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b84dd581fc4e9499cfecbb7242e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:29.236901 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-fa5ffd5f-834f-4679-9fa1-e86f1c158b9e tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] 10.222.0.13 "GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a" status: 200 len: 1513 microversion: 2.1 time: 0.162380 Jun 07 22:06:29.237531 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 295/560] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:29 2022] GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a => generated 1513 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:29.353928 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-a2da679b-af93-49f7-8108-844867485bc1 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.714356 Jun 07 22:06:29.354759 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 266/561] 10.222.0.13 () {60 vars in 1146 bytes} [Tue Jun 7 22:06:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 716 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 22:06:29.364401 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-9154afec-d9fb-4be7-be83-66a02ed8fea7 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:29.365878 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-9154afec-d9fb-4be7-be83-66a02ed8fea7 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: c2ece8dd-91fb-472c-b0c7-970ee215412f] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:29.421387 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-9154afec-d9fb-4be7-be83-66a02ed8fea7 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:29.428746 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-9154afec-d9fb-4be7-be83-66a02ed8fea7 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f" status: 200 len: 1095 microversion: 2.1 time: 0.068182 Jun 07 22:06:29.429308 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 296/562] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:29 2022] GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f => generated 1095 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:29.534665 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-724fd373-6bbe-4f13-90b3-e6faa4ddf474 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:29.535263 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-724fd373-6bbe-4f13-90b3-e6faa4ddf474 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: f84b4686-8e5c-49af-b5ad-13f37e20f976] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:29.541907 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-724fd373-6bbe-4f13-90b3-e6faa4ddf474 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:29.542346 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-724fd373-6bbe-4f13-90b3-e6faa4ddf474 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:29.543092 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-724fd373-6bbe-4f13-90b3-e6faa4ddf474 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:29.543557 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-724fd373-6bbe-4f13-90b3-e6faa4ddf474 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:29.643517 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-074b7ccf-152b-4e78-9df9-6ff4ad15b351 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:29.644764 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-074b7ccf-152b-4e78-9df9-6ff4ad15b351 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:29.652736 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-074b7ccf-152b-4e78-9df9-6ff4ad15b351 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:29.653722 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-074b7ccf-152b-4e78-9df9-6ff4ad15b351 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:29.654075 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-074b7ccf-152b-4e78-9df9-6ff4ad15b351 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:29.654957 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-074b7ccf-152b-4e78-9df9-6ff4ad15b351 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:29.693967 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-724fd373-6bbe-4f13-90b3-e6faa4ddf474 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:29.702245 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-724fd373-6bbe-4f13-90b3-e6faa4ddf474 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976" status: 200 len: 1370 microversion: 2.1 time: 0.171371 Jun 07 22:06:29.703188 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 267/563] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:29 2022] GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976 => generated 1370 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:29.799686 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-074b7ccf-152b-4e78-9df9-6ff4ad15b351 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af02cd6ffd0484c8f6569629cd6313c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31cd38d46643fbac516d21ee4f89ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:29.808232 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-074b7ccf-152b-4e78-9df9-6ff4ad15b351 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b" status: 200 len: 1357 microversion: 2.1 time: 0.169684 Jun 07 22:06:29.808884 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 297/564] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:29 2022] GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b => generated 1357 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:30.090347 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-a87fe46d-82d9-48ab-848b-c954eb5e836c tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:30.092153 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-a87fe46d-82d9-48ab-848b-c954eb5e836c tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 51fd7e4e-4aea-426f-ae93-cd9dde475a9b] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:30.098858 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a87fe46d-82d9-48ab-848b-c954eb5e836c tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:30.099302 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a87fe46d-82d9-48ab-848b-c954eb5e836c tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:30.100103 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a87fe46d-82d9-48ab-848b-c954eb5e836c tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:30.100529 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a87fe46d-82d9-48ab-848b-c954eb5e836c tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:30.230429 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-a87fe46d-82d9-48ab-848b-c954eb5e836c tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce9ec4aea9449d3890f6dbb93f97968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc558dd3848d4d3d950d7cd408e19741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:30.239257 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-a87fe46d-82d9-48ab-848b-c954eb5e836c tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b" status: 200 len: 1313 microversion: 2.1 time: 0.152968 Jun 07 22:06:30.239847 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 268/565] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:30 2022] GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:30.254001 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-96dbadea-15f3-4d6c-8d44-f4b2e5f3d099 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:30.254651 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-96dbadea-15f3-4d6c-8d44-f4b2e5f3d099 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] [instance: 8f7f3be8-21d5-446e-9ee5-0caa7c97a68a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:30.261898 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-96dbadea-15f3-4d6c-8d44-f4b2e5f3d099 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:30.262356 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-96dbadea-15f3-4d6c-8d44-f4b2e5f3d099 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:30.263201 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-96dbadea-15f3-4d6c-8d44-f4b2e5f3d099 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:30.263689 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-96dbadea-15f3-4d6c-8d44-f4b2e5f3d099 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:30.392368 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-96dbadea-15f3-4d6c-8d44-f4b2e5f3d099 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4fc7744b3d4e5fb6e281fcc90cef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b84dd581fc4e9499cfecbb7242e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:30.399962 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-96dbadea-15f3-4d6c-8d44-f4b2e5f3d099 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] 10.222.0.13 "GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a" status: 200 len: 1513 microversion: 2.1 time: 0.149917 Jun 07 22:06:30.400536 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 298/566] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:30 2022] GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:30.445473 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-b2a28d16-a31a-408c-810f-67cf751123b7 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:30.446095 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-b2a28d16-a31a-408c-810f-67cf751123b7 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: c2ece8dd-91fb-472c-b0c7-970ee215412f] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:30.452375 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-b2a28d16-a31a-408c-810f-67cf751123b7 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:30.452831 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-b2a28d16-a31a-408c-810f-67cf751123b7 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:30.453610 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-b2a28d16-a31a-408c-810f-67cf751123b7 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:30.454054 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-b2a28d16-a31a-408c-810f-67cf751123b7 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:30.526371 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-b2a28d16-a31a-408c-810f-67cf751123b7 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:30.533705 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-b2a28d16-a31a-408c-810f-67cf751123b7 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f" status: 200 len: 1145 microversion: 2.1 time: 0.092331 Jun 07 22:06:30.534283 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 269/567] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:30 2022] GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f => generated 1145 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:30.564016 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [req-1906d73d-9a1e-4a5f-bbe5-b5b2696c3578 req-f8ba81da-2a7b-4fd2-97e0-370262495ad4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f7f3be8-21d5-446e-9ee5-0caa7c97a68a", "name": "network-vif-unplugged", "status": "completed", "tag": "68d9825d-4732-4ff9-baca-ebb1dff29654"}]} {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:06:30.573177 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-1906d73d-9a1e-4a5f-bbe5-b5b2696c3578 req-f8ba81da-2a7b-4fd2-97e0-370262495ad4 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:30.573649 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-1906d73d-9a1e-4a5f-bbe5-b5b2696c3578 req-f8ba81da-2a7b-4fd2-97e0-370262495ad4 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:30.585825 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.compute.server_external_events [req-1906d73d-9a1e-4a5f-bbe5-b5b2696c3578 req-f8ba81da-2a7b-4fd2-97e0-370262495ad4 service nova] Creating event network-vif-unplugged:68d9825d-4732-4ff9-baca-ebb1dff29654 for instance 8f7f3be8-21d5-446e-9ee5-0caa7c97a68a on hv-cinder-83552 Jun 07 22:06:30.590788 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [req-1906d73d-9a1e-4a5f-bbe5-b5b2696c3578 req-f8ba81da-2a7b-4fd2-97e0-370262495ad4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032788 Jun 07 22:06:30.591564 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 299/568] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:06:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:06:30.719349 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-94a198ec-4c60-4739-b790-199290e154a5 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:30.719992 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-94a198ec-4c60-4739-b790-199290e154a5 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: f84b4686-8e5c-49af-b5ad-13f37e20f976] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:30.727247 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-94a198ec-4c60-4739-b790-199290e154a5 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:30.727736 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-94a198ec-4c60-4739-b790-199290e154a5 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:30.728519 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-94a198ec-4c60-4739-b790-199290e154a5 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:30.728984 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-94a198ec-4c60-4739-b790-199290e154a5 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:30.825168 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-bdf970b1-5008-4e21-8c78-c2b355892dd9 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:30.825867 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-bdf970b1-5008-4e21-8c78-c2b355892dd9 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:30.832294 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-bdf970b1-5008-4e21-8c78-c2b355892dd9 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:30.832746 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-bdf970b1-5008-4e21-8c78-c2b355892dd9 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:30.833519 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-bdf970b1-5008-4e21-8c78-c2b355892dd9 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:30.834748 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-bdf970b1-5008-4e21-8c78-c2b355892dd9 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:30.866114 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-94a198ec-4c60-4739-b790-199290e154a5 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:30.873704 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-94a198ec-4c60-4739-b790-199290e154a5 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976" status: 200 len: 1370 microversion: 2.1 time: 0.158168 Jun 07 22:06:30.874287 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 270/569] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:30 2022] GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976 => generated 1370 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:30.963646 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-bdf970b1-5008-4e21-8c78-c2b355892dd9 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af02cd6ffd0484c8f6569629cd6313c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31cd38d46643fbac516d21ee4f89ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:30.971031 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-bdf970b1-5008-4e21-8c78-c2b355892dd9 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b" status: 200 len: 1357 microversion: 2.1 time: 0.150032 Jun 07 22:06:30.971623 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 300/570] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:30 2022] GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b => generated 1357 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:06:31.256891 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-9133cd27-be60-4f7c-be14-4fd489003194 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:31.257505 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-9133cd27-be60-4f7c-be14-4fd489003194 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 51fd7e4e-4aea-426f-ae93-cd9dde475a9b] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:31.263453 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-9133cd27-be60-4f7c-be14-4fd489003194 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:31.263896 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-9133cd27-be60-4f7c-be14-4fd489003194 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:31.264639 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-9133cd27-be60-4f7c-be14-4fd489003194 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:31.265068 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-9133cd27-be60-4f7c-be14-4fd489003194 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:31.397256 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-9133cd27-be60-4f7c-be14-4fd489003194 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce9ec4aea9449d3890f6dbb93f97968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc558dd3848d4d3d950d7cd408e19741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:31.404758 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-9133cd27-be60-4f7c-be14-4fd489003194 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b" status: 200 len: 1313 microversion: 2.1 time: 0.152394 Jun 07 22:06:31.405338 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 271/571] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:31 2022] GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:31.417734 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-71307bdb-3a26-4836-a2f1-a615c6e081e7 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:31.418456 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-71307bdb-3a26-4836-a2f1-a615c6e081e7 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] [instance: 8f7f3be8-21d5-446e-9ee5-0caa7c97a68a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:31.429257 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-71307bdb-3a26-4836-a2f1-a615c6e081e7 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:31.429706 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-71307bdb-3a26-4836-a2f1-a615c6e081e7 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:31.430657 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-71307bdb-3a26-4836-a2f1-a615c6e081e7 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:31.431137 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-71307bdb-3a26-4836-a2f1-a615c6e081e7 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:31.551228 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-95179529-e609-404d-a918-e23414b1eede tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:31.551861 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-95179529-e609-404d-a918-e23414b1eede tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: c2ece8dd-91fb-472c-b0c7-970ee215412f] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:31.554446 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:06:31.559866 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-95179529-e609-404d-a918-e23414b1eede tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:31.560352 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-95179529-e609-404d-a918-e23414b1eede tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:31.561139 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-95179529-e609-404d-a918-e23414b1eede tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:31.561572 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-95179529-e609-404d-a918-e23414b1eede tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:31.575109 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-71307bdb-3a26-4836-a2f1-a615c6e081e7 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4fc7744b3d4e5fb6e281fcc90cef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b84dd581fc4e9499cfecbb7242e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:31.582451 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-71307bdb-3a26-4836-a2f1-a615c6e081e7 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] 10.222.0.13 "GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a" status: 200 len: 1513 microversion: 2.1 time: 0.168623 Jun 07 22:06:31.583003 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 301/572] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:31 2022] GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a => generated 1513 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:31.626406 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-95179529-e609-404d-a918-e23414b1eede tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:31.634273 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-95179529-e609-404d-a918-e23414b1eede tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f" status: 200 len: 1145 microversion: 2.1 time: 0.086839 Jun 07 22:06:31.634838 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 272/573] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:31 2022] GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f => generated 1145 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:06:31.891894 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-f4cb730c-b6fb-4adb-8f16-e3d8fa4d6a8c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:31.892554 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-f4cb730c-b6fb-4adb-8f16-e3d8fa4d6a8c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: f84b4686-8e5c-49af-b5ad-13f37e20f976] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:31.898708 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-f4cb730c-b6fb-4adb-8f16-e3d8fa4d6a8c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:31.899138 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-f4cb730c-b6fb-4adb-8f16-e3d8fa4d6a8c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:31.899909 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-f4cb730c-b6fb-4adb-8f16-e3d8fa4d6a8c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:31.900341 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-f4cb730c-b6fb-4adb-8f16-e3d8fa4d6a8c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:31.990045 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-1fd77021-c813-4679-85bb-85d6a6a74ea9 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:31.990934 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-1fd77021-c813-4679-85bb-85d6a6a74ea9 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:31.997887 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1fd77021-c813-4679-85bb-85d6a6a74ea9 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:31.998406 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1fd77021-c813-4679-85bb-85d6a6a74ea9 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:31.999170 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1fd77021-c813-4679-85bb-85d6a6a74ea9 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:31.999626 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1fd77021-c813-4679-85bb-85d6a6a74ea9 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:32.033054 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-f4cb730c-b6fb-4adb-8f16-e3d8fa4d6a8c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:32.041516 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-f4cb730c-b6fb-4adb-8f16-e3d8fa4d6a8c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976" status: 200 len: 1370 microversion: 2.1 time: 0.153439 Jun 07 22:06:32.042086 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 302/574] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:31 2022] GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976 => generated 1370 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:32.134198 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-1fd77021-c813-4679-85bb-85d6a6a74ea9 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af02cd6ffd0484c8f6569629cd6313c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31cd38d46643fbac516d21ee4f89ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:32.141549 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-1fd77021-c813-4679-85bb-85d6a6a74ea9 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b" status: 200 len: 1357 microversion: 2.1 time: 0.157323 Jun 07 22:06:32.142169 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 273/575] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:31 2022] GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:06:32.421893 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-b921e872-1e33-4ad5-8dd7-9968b4e61e6d tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:32.422427 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-b921e872-1e33-4ad5-8dd7-9968b4e61e6d tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 51fd7e4e-4aea-426f-ae93-cd9dde475a9b] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:32.429585 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b921e872-1e33-4ad5-8dd7-9968b4e61e6d tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:32.430060 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b921e872-1e33-4ad5-8dd7-9968b4e61e6d tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:32.430811 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b921e872-1e33-4ad5-8dd7-9968b4e61e6d tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:32.431237 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b921e872-1e33-4ad5-8dd7-9968b4e61e6d tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:32.562495 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-b921e872-1e33-4ad5-8dd7-9968b4e61e6d tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce9ec4aea9449d3890f6dbb93f97968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc558dd3848d4d3d950d7cd408e19741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:32.573059 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-b921e872-1e33-4ad5-8dd7-9968b4e61e6d tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b" status: 200 len: 1313 microversion: 2.1 time: 0.154497 Jun 07 22:06:32.583750 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 303/576] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:32 2022] GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:32.599116 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-854c970f-d9e7-4539-99e6-8234ac90ac63 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:32.600642 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-854c970f-d9e7-4539-99e6-8234ac90ac63 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] [instance: 8f7f3be8-21d5-446e-9ee5-0caa7c97a68a] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:32.607160 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-854c970f-d9e7-4539-99e6-8234ac90ac63 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:32.607643 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-854c970f-d9e7-4539-99e6-8234ac90ac63 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:32.608403 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-854c970f-d9e7-4539-99e6-8234ac90ac63 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:32.608841 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-854c970f-d9e7-4539-99e6-8234ac90ac63 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:32.650075 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-f2df2b83-a383-4f38-9046-409b41d16671 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:32.650704 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-f2df2b83-a383-4f38-9046-409b41d16671 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: c2ece8dd-91fb-472c-b0c7-970ee215412f] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:32.659291 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-f2df2b83-a383-4f38-9046-409b41d16671 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:32.661210 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-f2df2b83-a383-4f38-9046-409b41d16671 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:32.664085 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-f2df2b83-a383-4f38-9046-409b41d16671 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:32.664544 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-f2df2b83-a383-4f38-9046-409b41d16671 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:32.751301 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-f2df2b83-a383-4f38-9046-409b41d16671 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:32.760542 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-f2df2b83-a383-4f38-9046-409b41d16671 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f" status: 200 len: 1145 microversion: 2.1 time: 0.114334 Jun 07 22:06:32.761458 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 304/577] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:32 2022] GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f => generated 1145 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:06:32.812547 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-854c970f-d9e7-4539-99e6-8234ac90ac63 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4fc7744b3d4e5fb6e281fcc90cef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b84dd581fc4e9499cfecbb7242e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:32.821194 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-854c970f-d9e7-4539-99e6-8234ac90ac63 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] 10.222.0.13 "GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a" status: 200 len: 1513 microversion: 2.1 time: 0.226013 Jun 07 22:06:32.821769 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 274/578] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:32 2022] GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a => generated 1513 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:32.862923 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [req-33e60c6f-2c84-4df0-ae4a-fb12dfce97f6 req-9ef51ead-cb08-4649-bf33-7081aea97cc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51fd7e4e-4aea-426f-ae93-cd9dde475a9b", "name": "network-vif-plugged", "status": "completed", "tag": "fbaaf338-165c-44a5-9c49-6020632ff9bc"}]} {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:06:32.871846 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-33e60c6f-2c84-4df0-ae4a-fb12dfce97f6 req-9ef51ead-cb08-4649-bf33-7081aea97cc9 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:32.872447 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-33e60c6f-2c84-4df0-ae4a-fb12dfce97f6 req-9ef51ead-cb08-4649-bf33-7081aea97cc9 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:32.884830 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.compute.server_external_events [req-33e60c6f-2c84-4df0-ae4a-fb12dfce97f6 req-9ef51ead-cb08-4649-bf33-7081aea97cc9 service nova] Creating event network-vif-plugged:fbaaf338-165c-44a5-9c49-6020632ff9bc for instance 51fd7e4e-4aea-426f-ae93-cd9dde475a9b on hv-cinder-83552 Jun 07 22:06:32.889577 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [req-33e60c6f-2c84-4df0-ae4a-fb12dfce97f6 req-9ef51ead-cb08-4649-bf33-7081aea97cc9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030952 Jun 07 22:06:32.890169 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 305/579] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:06:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:06:33.058451 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-fe1f47df-9312-4b9d-b344-15defb6c034c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:33.059474 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-fe1f47df-9312-4b9d-b344-15defb6c034c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: f84b4686-8e5c-49af-b5ad-13f37e20f976] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:33.066254 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-fe1f47df-9312-4b9d-b344-15defb6c034c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:33.066775 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-fe1f47df-9312-4b9d-b344-15defb6c034c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:33.074644 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-fe1f47df-9312-4b9d-b344-15defb6c034c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:33.075238 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-fe1f47df-9312-4b9d-b344-15defb6c034c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:33.159165 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-acf6bd18-4438-4894-886b-f8500232f6e7 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:33.159888 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-acf6bd18-4438-4894-886b-f8500232f6e7 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:33.166967 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-acf6bd18-4438-4894-886b-f8500232f6e7 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:33.167523 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-acf6bd18-4438-4894-886b-f8500232f6e7 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:33.168294 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-acf6bd18-4438-4894-886b-f8500232f6e7 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:33.168726 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-acf6bd18-4438-4894-886b-f8500232f6e7 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:33.344110 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-acf6bd18-4438-4894-886b-f8500232f6e7 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af02cd6ffd0484c8f6569629cd6313c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31cd38d46643fbac516d21ee4f89ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:33.353120 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-acf6bd18-4438-4894-886b-f8500232f6e7 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b" status: 200 len: 1357 microversion: 2.1 time: 0.198178 Jun 07 22:06:33.354004 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 306/580] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:33 2022] GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b => generated 1357 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:06:33.405519 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-fe1f47df-9312-4b9d-b344-15defb6c034c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:33.413421 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-fe1f47df-9312-4b9d-b344-15defb6c034c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976" status: 200 len: 1370 microversion: 2.1 time: 0.359131 Jun 07 22:06:33.413997 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 275/581] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:33 2022] GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976 => generated 1370 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:33.592665 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-1ea8e7ba-9f9f-4e40-8522-188bc2603a69 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:33.593658 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-1ea8e7ba-9f9f-4e40-8522-188bc2603a69 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 51fd7e4e-4aea-426f-ae93-cd9dde475a9b] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:33.622144 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-1ea8e7ba-9f9f-4e40-8522-188bc2603a69 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:33.622713 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-1ea8e7ba-9f9f-4e40-8522-188bc2603a69 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:33.624283 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-1ea8e7ba-9f9f-4e40-8522-188bc2603a69 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:33.624826 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-1ea8e7ba-9f9f-4e40-8522-188bc2603a69 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:33.777549 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-42a1e87b-239c-4ec1-a357-f4b88dff3142 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:33.779447 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-42a1e87b-239c-4ec1-a357-f4b88dff3142 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: c2ece8dd-91fb-472c-b0c7-970ee215412f] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:33.787290 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-42a1e87b-239c-4ec1-a357-f4b88dff3142 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:33.788186 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-42a1e87b-239c-4ec1-a357-f4b88dff3142 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:33.789153 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-42a1e87b-239c-4ec1-a357-f4b88dff3142 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:33.789826 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-42a1e87b-239c-4ec1-a357-f4b88dff3142 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:33.845536 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-1ea8e7ba-9f9f-4e40-8522-188bc2603a69 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce9ec4aea9449d3890f6dbb93f97968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc558dd3848d4d3d950d7cd408e19741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:33.854801 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-1ea8e7ba-9f9f-4e40-8522-188bc2603a69 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b" status: 200 len: 1313 microversion: 2.1 time: 0.268565 Jun 07 22:06:33.855396 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 307/582] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:33 2022] GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b => generated 1313 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:33.860088 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [req-cfc923cd-8a47-42b2-97a6-fc07cdf548c9 req-ce0a01b3-3eb1-446c-ab6d-93204a8a2b3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f7f3be8-21d5-446e-9ee5-0caa7c97a68a", "name": "network-vif-deleted", "tag": "68d9825d-4732-4ff9-baca-ebb1dff29654"}]} {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:06:33.862538 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-42a1e87b-239c-4ec1-a357-f4b88dff3142 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:33.869979 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-cfc923cd-8a47-42b2-97a6-fc07cdf548c9 req-ce0a01b3-3eb1-446c-ab6d-93204a8a2b3b service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:33.870416 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-cfc923cd-8a47-42b2-97a6-fc07cdf548c9 req-ce0a01b3-3eb1-446c-ab6d-93204a8a2b3b service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:33.871005 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-42a1e87b-239c-4ec1-a357-f4b88dff3142 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f" status: 200 len: 1193 microversion: 2.1 time: 0.097167 Jun 07 22:06:33.871703 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 276/583] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:33 2022] GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f => generated 1193 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:33.877400 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-52883610-906f-48c3-8b86-a254e687bf3b tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:33.878072 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-52883610-906f-48c3-8b86-a254e687bf3b tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] [instance: 8f7f3be8-21d5-446e-9ee5-0caa7c97a68a] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:33.884536 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.compute.server_external_events [req-cfc923cd-8a47-42b2-97a6-fc07cdf548c9 req-ce0a01b3-3eb1-446c-ab6d-93204a8a2b3b service nova] Creating event network-vif-deleted:68d9825d-4732-4ff9-baca-ebb1dff29654 for instance 8f7f3be8-21d5-446e-9ee5-0caa7c97a68a on hv-cinder-83552 Jun 07 22:06:33.887987 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-52883610-906f-48c3-8b86-a254e687bf3b tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:33.888436 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-52883610-906f-48c3-8b86-a254e687bf3b tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:33.889200 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-52883610-906f-48c3-8b86-a254e687bf3b tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:33.889627 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-52883610-906f-48c3-8b86-a254e687bf3b tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:33.890204 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [req-cfc923cd-8a47-42b2-97a6-fc07cdf548c9 req-ce0a01b3-3eb1-446c-ab6d-93204a8a2b3b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033537 Jun 07 22:06:33.891305 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 308/584] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:06:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:06:33.953841 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-52883610-906f-48c3-8b86-a254e687bf3b tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4fc7744b3d4e5fb6e281fcc90cef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b84dd581fc4e9499cfecbb7242e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:33.962340 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-52883610-906f-48c3-8b86-a254e687bf3b tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] 10.222.0.13 "GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a" status: 200 len: 1471 microversion: 2.1 time: 0.089631 Jun 07 22:06:33.968204 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 277/585] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:33 2022] GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a => generated 1471 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:34.371111 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-a3821a04-19af-4809-ae14-68dc8231b23e tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:34.371837 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-a3821a04-19af-4809-ae14-68dc8231b23e tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:34.379244 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a3821a04-19af-4809-ae14-68dc8231b23e tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:34.379925 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a3821a04-19af-4809-ae14-68dc8231b23e tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:34.381189 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a3821a04-19af-4809-ae14-68dc8231b23e tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:34.381720 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a3821a04-19af-4809-ae14-68dc8231b23e tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:34.432182 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-9c05b668-7189-4a21-9c04-3dafd20f10e1 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:34.432792 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-9c05b668-7189-4a21-9c04-3dafd20f10e1 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: f84b4686-8e5c-49af-b5ad-13f37e20f976] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:34.438778 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-9c05b668-7189-4a21-9c04-3dafd20f10e1 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:34.439228 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-9c05b668-7189-4a21-9c04-3dafd20f10e1 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:34.440027 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-9c05b668-7189-4a21-9c04-3dafd20f10e1 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:34.440464 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-9c05b668-7189-4a21-9c04-3dafd20f10e1 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:34.517550 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-a3821a04-19af-4809-ae14-68dc8231b23e tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af02cd6ffd0484c8f6569629cd6313c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31cd38d46643fbac516d21ee4f89ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:34.526886 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-a3821a04-19af-4809-ae14-68dc8231b23e tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b" status: 200 len: 1357 microversion: 2.1 time: 0.159989 Jun 07 22:06:34.527480 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 309/586] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:34 2022] GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:06:34.575304 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-9c05b668-7189-4a21-9c04-3dafd20f10e1 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:34.582766 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-9c05b668-7189-4a21-9c04-3dafd20f10e1 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976" status: 200 len: 1370 microversion: 2.1 time: 0.156311 Jun 07 22:06:34.583320 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 278/587] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:34 2022] GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976 => generated 1370 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:34.872059 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-b60ecf8d-800a-46a4-88f4-697d4c205210 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:34.872674 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-b60ecf8d-800a-46a4-88f4-697d4c205210 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 51fd7e4e-4aea-426f-ae93-cd9dde475a9b] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:34.879037 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b60ecf8d-800a-46a4-88f4-697d4c205210 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:34.879676 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b60ecf8d-800a-46a4-88f4-697d4c205210 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:34.880327 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b60ecf8d-800a-46a4-88f4-697d4c205210 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:34.880763 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b60ecf8d-800a-46a4-88f4-697d4c205210 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:34.889577 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-954e3b48-bb65-4048-86da-bd7cc8e04bbf tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:34.890222 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-954e3b48-bb65-4048-86da-bd7cc8e04bbf tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: c2ece8dd-91fb-472c-b0c7-970ee215412f] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:34.897063 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-954e3b48-bb65-4048-86da-bd7cc8e04bbf tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:34.897545 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-954e3b48-bb65-4048-86da-bd7cc8e04bbf tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:34.898290 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-954e3b48-bb65-4048-86da-bd7cc8e04bbf tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:34.898752 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-954e3b48-bb65-4048-86da-bd7cc8e04bbf tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:34.967737 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-954e3b48-bb65-4048-86da-bd7cc8e04bbf tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:34.978377 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-954e3b48-bb65-4048-86da-bd7cc8e04bbf tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f" status: 200 len: 1193 microversion: 2.1 time: 0.092865 Jun 07 22:06:34.987825 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 279/588] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:34 2022] GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f => generated 1193 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:06:34.987825 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-446d6d68-5fe0-4cb8-bac6-1ec37f1ac773 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:34.987825 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-446d6d68-5fe0-4cb8-bac6-1ec37f1ac773 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] [instance: 8f7f3be8-21d5-446e-9ee5-0caa7c97a68a] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:34.992136 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-446d6d68-5fe0-4cb8-bac6-1ec37f1ac773 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:34.993141 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-446d6d68-5fe0-4cb8-bac6-1ec37f1ac773 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:34.993911 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-446d6d68-5fe0-4cb8-bac6-1ec37f1ac773 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:34.994350 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-446d6d68-5fe0-4cb8-bac6-1ec37f1ac773 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:35.032248 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-b60ecf8d-800a-46a4-88f4-697d4c205210 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce9ec4aea9449d3890f6dbb93f97968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc558dd3848d4d3d950d7cd408e19741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:35.040395 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-b60ecf8d-800a-46a4-88f4-697d4c205210 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b" status: 200 len: 1313 microversion: 2.1 time: 0.172190 Jun 07 22:06:35.040972 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 310/589] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:34 2022] GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:06:35.058115 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-446d6d68-5fe0-4cb8-bac6-1ec37f1ac773 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4fc7744b3d4e5fb6e281fcc90cef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b84dd581fc4e9499cfecbb7242e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:35.065524 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-446d6d68-5fe0-4cb8-bac6-1ec37f1ac773 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] 10.222.0.13 "GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a" status: 200 len: 1303 microversion: 2.1 time: 0.085572 Jun 07 22:06:35.066085 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 280/590] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:34 2022] GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a => generated 1303 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:35.543320 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-2fa7c3fc-8d42-4ef0-a932-3b019b1bc3e9 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:35.543872 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-2fa7c3fc-8d42-4ef0-a932-3b019b1bc3e9 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:35.550495 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-2fa7c3fc-8d42-4ef0-a932-3b019b1bc3e9 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:35.550944 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-2fa7c3fc-8d42-4ef0-a932-3b019b1bc3e9 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:35.551737 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-2fa7c3fc-8d42-4ef0-a932-3b019b1bc3e9 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:35.552159 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-2fa7c3fc-8d42-4ef0-a932-3b019b1bc3e9 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:35.572245 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_cell1:SELECT=100 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:06:35.600853 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-2f616bbc-67e0-48b3-904e-ce1f5c800850 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:35.601876 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-2f616bbc-67e0-48b3-904e-ce1f5c800850 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: f84b4686-8e5c-49af-b5ad-13f37e20f976] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:35.607710 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-2f616bbc-67e0-48b3-904e-ce1f5c800850 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:35.608149 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-2f616bbc-67e0-48b3-904e-ce1f5c800850 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:35.608906 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-2f616bbc-67e0-48b3-904e-ce1f5c800850 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:35.609365 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-2f616bbc-67e0-48b3-904e-ce1f5c800850 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:35.624894 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_cell1:SELECT=100 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:06:35.694441 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-2fa7c3fc-8d42-4ef0-a932-3b019b1bc3e9 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af02cd6ffd0484c8f6569629cd6313c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31cd38d46643fbac516d21ee4f89ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:35.702001 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-2fa7c3fc-8d42-4ef0-a932-3b019b1bc3e9 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b" status: 200 len: 1357 microversion: 2.1 time: 0.162596 Jun 07 22:06:35.702575 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 311/591] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:35 2022] GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:35.745255 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-2f616bbc-67e0-48b3-904e-ce1f5c800850 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:35.752678 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-2f616bbc-67e0-48b3-904e-ce1f5c800850 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976" status: 200 len: 1370 microversion: 2.1 time: 0.155606 Jun 07 22:06:35.753320 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 281/592] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:35 2022] GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976 => generated 1370 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:06:35.995790 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-71eae78c-aead-4f0b-b612-fbf3cde463b3 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:35.996395 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-71eae78c-aead-4f0b-b612-fbf3cde463b3 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: c2ece8dd-91fb-472c-b0c7-970ee215412f] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:36.002321 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-71eae78c-aead-4f0b-b612-fbf3cde463b3 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:36.002764 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-71eae78c-aead-4f0b-b612-fbf3cde463b3 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:36.003548 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-71eae78c-aead-4f0b-b612-fbf3cde463b3 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:36.003976 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-71eae78c-aead-4f0b-b612-fbf3cde463b3 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:36.057906 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-831a1791-a4a1-4527-a36f-a84d2c25f764 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:36.058537 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-831a1791-a4a1-4527-a36f-a84d2c25f764 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 51fd7e4e-4aea-426f-ae93-cd9dde475a9b] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:36.064575 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-831a1791-a4a1-4527-a36f-a84d2c25f764 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:36.065018 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-831a1791-a4a1-4527-a36f-a84d2c25f764 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:36.065771 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-831a1791-a4a1-4527-a36f-a84d2c25f764 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:36.066093 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-71eae78c-aead-4f0b-b612-fbf3cde463b3 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:36.066216 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-831a1791-a4a1-4527-a36f-a84d2c25f764 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:36.073523 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-71eae78c-aead-4f0b-b612-fbf3cde463b3 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f" status: 200 len: 1211 microversion: 2.1 time: 0.081770 Jun 07 22:06:36.074083 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 312/593] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:35 2022] GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f => generated 1211 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:06:36.082099 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-ab7d7a09-7865-485e-8154-119dda8eefd2 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:36.082701 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-ab7d7a09-7865-485e-8154-119dda8eefd2 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] [instance: 8f7f3be8-21d5-446e-9ee5-0caa7c97a68a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:36.088789 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ab7d7a09-7865-485e-8154-119dda8eefd2 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:36.089235 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ab7d7a09-7865-485e-8154-119dda8eefd2 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:36.089988 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ab7d7a09-7865-485e-8154-119dda8eefd2 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:36.090419 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ab7d7a09-7865-485e-8154-119dda8eefd2 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:36.122435 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ab7d7a09-7865-485e-8154-119dda8eefd2 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:36.122789 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ab7d7a09-7865-485e-8154-119dda8eefd2 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:36.123238 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.objects.instance [None req-ab7d7a09-7865-485e-8154-119dda8eefd2 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lazy-loading 'fault' on Instance uuid 8f7f3be8-21d5-446e-9ee5-0caa7c97a68a {{(pid=117971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 22:06:36.165680 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-ab7d7a09-7865-485e-8154-119dda8eefd2 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4fc7744b3d4e5fb6e281fcc90cef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b84dd581fc4e9499cfecbb7242e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:36.173131 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-ab7d7a09-7865-485e-8154-119dda8eefd2 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] 10.222.0.13 "GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a" status: 200 len: 1308 microversion: 2.1 time: 0.094582 Jun 07 22:06:36.173698 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 313/594] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:36 2022] GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a => generated 1308 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:06:36.198945 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-831a1791-a4a1-4527-a36f-a84d2c25f764 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce9ec4aea9449d3890f6dbb93f97968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc558dd3848d4d3d950d7cd408e19741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:36.206463 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-831a1791-a4a1-4527-a36f-a84d2c25f764 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b" status: 200 len: 1497 microversion: 2.1 time: 0.152493 Jun 07 22:06:36.207043 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 282/595] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:36 2022] GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b => generated 1497 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:36.720601 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-2c7145b6-788b-4303-8e50-79e06261e84e tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:36.721218 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-2c7145b6-788b-4303-8e50-79e06261e84e tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:36.740263 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-2c7145b6-788b-4303-8e50-79e06261e84e tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:36.741246 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-2c7145b6-788b-4303-8e50-79e06261e84e tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:36.742321 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-2c7145b6-788b-4303-8e50-79e06261e84e tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:36.742919 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-2c7145b6-788b-4303-8e50-79e06261e84e tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:36.743045 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-4ad8da70-fcf7-4c44-beee-628c0705a3d9 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:36.743594 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-4ad8da70-fcf7-4c44-beee-628c0705a3d9 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 51fd7e4e-4aea-426f-ae93-cd9dde475a9b] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:36.759087 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4ad8da70-fcf7-4c44-beee-628c0705a3d9 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:36.762809 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4ad8da70-fcf7-4c44-beee-628c0705a3d9 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:36.764478 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4ad8da70-fcf7-4c44-beee-628c0705a3d9 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:36.765394 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4ad8da70-fcf7-4c44-beee-628c0705a3d9 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:36.824294 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-4ad8da70-fcf7-4c44-beee-628c0705a3d9 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 51fd7e4e-4aea-426f-ae93-cd9dde475a9b] Going to try to terminate instance {{(pid=117970) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 22:06:36.947054 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-4ad8da70-fcf7-4c44-beee-628c0705a3d9 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "DELETE /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b" status: 204 len: 0 microversion: 2.1 time: 0.208944 Jun 07 22:06:36.947912 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 283/596] 10.222.0.13 () {58 vars in 1238 bytes} [Tue Jun 7 22:06:36 2022] DELETE /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 07 22:06:36.963032 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-252043e5-5817-48cf-8ede-f4a514940d16 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:36.963814 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-252043e5-5817-48cf-8ede-f4a514940d16 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: f84b4686-8e5c-49af-b5ad-13f37e20f976] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:36.975387 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-252043e5-5817-48cf-8ede-f4a514940d16 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:36.975840 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-252043e5-5817-48cf-8ede-f4a514940d16 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:36.977010 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-252043e5-5817-48cf-8ede-f4a514940d16 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:36.977545 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-252043e5-5817-48cf-8ede-f4a514940d16 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:37.060639 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-2c7145b6-788b-4303-8e50-79e06261e84e tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af02cd6ffd0484c8f6569629cd6313c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31cd38d46643fbac516d21ee4f89ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:37.071167 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-2c7145b6-788b-4303-8e50-79e06261e84e tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b" status: 200 len: 1357 microversion: 2.1 time: 0.354966 Jun 07 22:06:37.071866 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 314/597] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:36 2022] GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b => generated 1357 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:37.076361 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-15e4fe76-b77f-4566-a94f-ae7291f4fd7e tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:37.077297 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-15e4fe76-b77f-4566-a94f-ae7291f4fd7e tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 51fd7e4e-4aea-426f-ae93-cd9dde475a9b] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:37.083471 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-15e4fe76-b77f-4566-a94f-ae7291f4fd7e tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:37.083915 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-15e4fe76-b77f-4566-a94f-ae7291f4fd7e tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:37.084667 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-15e4fe76-b77f-4566-a94f-ae7291f4fd7e tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:37.085126 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-15e4fe76-b77f-4566-a94f-ae7291f4fd7e tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:37.214895 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-15e4fe76-b77f-4566-a94f-ae7291f4fd7e tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce9ec4aea9449d3890f6dbb93f97968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc558dd3848d4d3d950d7cd408e19741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:37.223854 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-15e4fe76-b77f-4566-a94f-ae7291f4fd7e tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b" status: 200 len: 1503 microversion: 2.1 time: 0.150806 Jun 07 22:06:37.224682 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 315/598] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:37 2022] GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b => generated 1503 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:37.231561 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-252043e5-5817-48cf-8ede-f4a514940d16 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:37.232428 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [req-758fd414-6d6e-477e-b0f5-4b5ad77d2ba0 req-648dbaae-d6b0-4e4d-be25-81964c83e668 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbab64b0-0fb5-49d7-aeeb-d744856ddc2b", "name": "network-vif-plugged", "status": "completed", "tag": "93fff328-2cf7-4f1c-9e4e-23777eeb1a75"}]} {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:06:37.239549 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-758fd414-6d6e-477e-b0f5-4b5ad77d2ba0 req-648dbaae-d6b0-4e4d-be25-81964c83e668 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:37.240577 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-252043e5-5817-48cf-8ede-f4a514940d16 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976" status: 200 len: 1370 microversion: 2.1 time: 0.290924 Jun 07 22:06:37.240880 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-758fd414-6d6e-477e-b0f5-4b5ad77d2ba0 req-648dbaae-d6b0-4e4d-be25-81964c83e668 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:37.241354 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 284/599] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:36 2022] GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976 => generated 1370 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:37.246301 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-f54cb36d-aa99-423d-8a57-1dbab5d8628e tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:37.247029 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-f54cb36d-aa99-423d-8a57-1dbab5d8628e tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: c2ece8dd-91fb-472c-b0c7-970ee215412f] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:37.253039 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f54cb36d-aa99-423d-8a57-1dbab5d8628e tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:37.253594 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f54cb36d-aa99-423d-8a57-1dbab5d8628e tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:37.253707 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.compute.server_external_events [req-758fd414-6d6e-477e-b0f5-4b5ad77d2ba0 req-648dbaae-d6b0-4e4d-be25-81964c83e668 service nova] Creating event network-vif-plugged:93fff328-2cf7-4f1c-9e4e-23777eeb1a75 for instance fbab64b0-0fb5-49d7-aeeb-d744856ddc2b on hv-cinder-83552 Jun 07 22:06:37.254555 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f54cb36d-aa99-423d-8a57-1dbab5d8628e tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:37.255047 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f54cb36d-aa99-423d-8a57-1dbab5d8628e tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:37.259004 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [req-758fd414-6d6e-477e-b0f5-4b5ad77d2ba0 req-648dbaae-d6b0-4e4d-be25-81964c83e668 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032974 Jun 07 22:06:37.259645 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 316/600] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:06:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:06:37.266440 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-432b68ed-ce3d-43e0-8499-051de6b79929 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:37.267364 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-432b68ed-ce3d-43e0-8499-051de6b79929 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] [instance: 8f7f3be8-21d5-446e-9ee5-0caa7c97a68a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:37.282109 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-432b68ed-ce3d-43e0-8499-051de6b79929 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:37.282721 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-432b68ed-ce3d-43e0-8499-051de6b79929 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:37.283643 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-432b68ed-ce3d-43e0-8499-051de6b79929 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:37.284148 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-432b68ed-ce3d-43e0-8499-051de6b79929 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:37.300602 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.wsgi [None req-432b68ed-ce3d-43e0-8499-051de6b79929 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] HTTP exception thrown: Instance 8f7f3be8-21d5-446e-9ee5-0caa7c97a68a could not be found. Jun 07 22:06:37.302317 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-432b68ed-ce3d-43e0-8499-051de6b79929 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Request method failure captured: Jun 07 22:06:37.302317 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: request: GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a HTTP/1.1 Jun 07 22:06:37.302317 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Accept: application/json Jun 07 22:06:37.302317 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Accept-Encoding: identity Jun 07 22:06:37.302317 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Connection: close Jun 07 22:06:37.302317 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Content-Length: 0 Jun 07 22:06:37.302317 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Content-Type: application/json Jun 07 22:06:37.302317 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Host: 10.222.0.13 Jun 07 22:06:37.302317 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Openstack-System-Scope: None Jun 07 22:06:37.302317 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: User-Agent: python-urllib3/1.26.9 Jun 07 22:06:37.302317 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Auth-Token: gAAAAABin8tZZ7eOPINycaXgfOFYx_8RYsFe5AHLGbaP1lxUe1oG1fKFiABNwrXMVjS9cmcKBfrX73OwlY6fUceKEYgi_hDm_to8R5NJpn1UlJaYGaX4LjHdIHJ6xUmekIZPRdHH5EZE_PrSiLH3eYvMTkzgjsTuV2uBUDnkv4OyvRrToMfBqvg Jun 07 22:06:37.302317 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Domain-Id: None Jun 07 22:06:37.302317 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Domain-Name: None Jun 07 22:06:37.302317 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Identity-Status: Confirmed Jun 07 22:06:37.302317 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Is-Admin-Project: True Jun 07 22:06:37.302317 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Domain-Id: default Jun 07 22:06:37.302317 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Domain-Name: Default Jun 07 22:06:37.302317 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Id: d3b84dd581fc4e9499cfecbb7242e3b3 Jun 07 22:06:37.302317 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1290034794 Jun 07 22:06:37.302317 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Role: member,reader Jun 07 22:06:37.302317 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Roles: member,reader Jun 07 22:06:37.304370 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d3b84dd581fc4e9499cfecbb7242e3b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_d3b84dd581fc4e9499cfecbb7242e3b3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d3b84dd581fc4e9499cfecbb7242e3b3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/d3b84dd581fc4e9499cfecbb7242e3b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}] Jun 07 22:06:37.304370 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant: tempest-VolumesSnapshotTestJSON-1290034794 Jun 07 22:06:37.304370 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant-Id: d3b84dd581fc4e9499cfecbb7242e3b3 Jun 07 22:06:37.304370 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1290034794 Jun 07 22:06:37.304370 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User: tempest-VolumesSnapshotTestJSON-1290034794-project Jun 07 22:06:37.304370 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Domain-Id: default Jun 07 22:06:37.304370 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Domain-Name: Default Jun 07 22:06:37.304370 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Id: fa4fc7744b3d4e5fb6e281fcc90cef5e Jun 07 22:06:37.304370 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Name: tempest-VolumesSnapshotTestJSON-1290034794-project Jun 07 22:06:37.304370 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: method: > Jun 07 22:06:37.304370 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: exception: Instance 8f7f3be8-21d5-446e-9ee5-0caa7c97a68a could not be found. Jun 07 22:06:37.304370 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: action_args: {'id': '8f7f3be8-21d5-446e-9ee5-0caa7c97a68a'} Jun 07 22:06:37.305513 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 22:06:37.305513 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:06:37.305513 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 22:06:37.305513 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 22:06:37.305513 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 22:06:37.305513 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 22:06:37.305513 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 22:06:37.305513 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 22:06:37.305513 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 22:06:37.305513 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 22:06:37.305513 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f7f3be8-21d5-446e-9ee5-0caa7c97a68a could not be found. Jun 07 22:06:37.305513 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:06:37.305513 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:06:37.305513 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:06:37.305513 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:06:37.305513 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:06:37.305513 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:06:37.305513 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 22:06:37.305513 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 22:06:37.305513 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 22:06:37.307829 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 22:06:37.307829 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 22:06:37.307829 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 22:06:37.307829 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 22:06:37.307829 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 22:06:37.307829 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 22:06:37.307829 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 22:06:37.307829 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f7f3be8-21d5-446e-9ee5-0caa7c97a68a could not be found. Jun 07 22:06:37.307829 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:06:37.307829 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:06:37.307829 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:06:37.307829 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:06:37.307829 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:06:37.307829 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:06:37.307829 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 22:06:37.307829 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 22:06:37.307829 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f7f3be8-21d5-446e-9ee5-0caa7c97a68a could not be found. Jun 07 22:06:37.307829 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:06:37.309131 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-432b68ed-ce3d-43e0-8499-051de6b79929 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Returning 404 to user: Instance 8f7f3be8-21d5-446e-9ee5-0caa7c97a68a could not be found. {{(pid=117971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 22:06:37.309131 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-432b68ed-ce3d-43e0-8499-051de6b79929 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] 10.222.0.13 "GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a" status: 404 len: 111 microversion: 2.1 time: 0.043220 Jun 07 22:06:37.309131 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 317/601] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:37 2022] GET /compute/v2.1/servers/8f7f3be8-21d5-446e-9ee5-0caa7c97a68a => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 22:06:37.343300 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-f54cb36d-aa99-423d-8a57-1dbab5d8628e tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:37.350780 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-f54cb36d-aa99-423d-8a57-1dbab5d8628e tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f" status: 200 len: 1211 microversion: 2.1 time: 0.108351 Jun 07 22:06:37.352055 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 285/602] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:37 2022] GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f => generated 1211 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:38.087630 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-e52bea40-ccd6-43ec-9dea-6c2334840f82 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:38.088232 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-e52bea40-ccd6-43ec-9dea-6c2334840f82 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:38.094649 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e52bea40-ccd6-43ec-9dea-6c2334840f82 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:38.095088 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e52bea40-ccd6-43ec-9dea-6c2334840f82 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:38.095873 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e52bea40-ccd6-43ec-9dea-6c2334840f82 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:38.096302 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e52bea40-ccd6-43ec-9dea-6c2334840f82 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:38.226050 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-e52bea40-ccd6-43ec-9dea-6c2334840f82 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af02cd6ffd0484c8f6569629cd6313c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31cd38d46643fbac516d21ee4f89ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:38.233664 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-e52bea40-ccd6-43ec-9dea-6c2334840f82 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b" status: 200 len: 1357 microversion: 2.1 time: 0.150445 Jun 07 22:06:38.234216 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 318/603] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:38 2022] GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:38.242027 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-17942f6c-a5e0-44f7-8506-cbeb1b854ef3 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:38.242672 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-17942f6c-a5e0-44f7-8506-cbeb1b854ef3 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 51fd7e4e-4aea-426f-ae93-cd9dde475a9b] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:38.248630 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-17942f6c-a5e0-44f7-8506-cbeb1b854ef3 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:38.249073 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-17942f6c-a5e0-44f7-8506-cbeb1b854ef3 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:38.249827 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-17942f6c-a5e0-44f7-8506-cbeb1b854ef3 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:38.250260 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-17942f6c-a5e0-44f7-8506-cbeb1b854ef3 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:38.257122 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-6842caa3-204d-4c9b-91be-76fccfa10a69 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:38.257665 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-6842caa3-204d-4c9b-91be-76fccfa10a69 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: f84b4686-8e5c-49af-b5ad-13f37e20f976] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:38.263601 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-6842caa3-204d-4c9b-91be-76fccfa10a69 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:38.264051 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-6842caa3-204d-4c9b-91be-76fccfa10a69 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:38.264806 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-6842caa3-204d-4c9b-91be-76fccfa10a69 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:38.265243 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-6842caa3-204d-4c9b-91be-76fccfa10a69 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:38.379594 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-17942f6c-a5e0-44f7-8506-cbeb1b854ef3 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce9ec4aea9449d3890f6dbb93f97968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc558dd3848d4d3d950d7cd408e19741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:38.387057 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-17942f6c-a5e0-44f7-8506-cbeb1b854ef3 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b" status: 200 len: 1503 microversion: 2.1 time: 0.149510 Jun 07 22:06:38.387660 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 286/604] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:38 2022] GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b => generated 1503 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:38.392097 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-4279a5eb-7772-404d-8a5c-2bfc02f69a43 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:38.392876 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-4279a5eb-7772-404d-8a5c-2bfc02f69a43 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: c2ece8dd-91fb-472c-b0c7-970ee215412f] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:38.393582 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-6842caa3-204d-4c9b-91be-76fccfa10a69 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:38.398982 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4279a5eb-7772-404d-8a5c-2bfc02f69a43 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:38.399455 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4279a5eb-7772-404d-8a5c-2bfc02f69a43 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:38.400204 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4279a5eb-7772-404d-8a5c-2bfc02f69a43 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:38.400629 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4279a5eb-7772-404d-8a5c-2bfc02f69a43 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:38.401338 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-6842caa3-204d-4c9b-91be-76fccfa10a69 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976" status: 200 len: 1370 microversion: 2.1 time: 0.147986 Jun 07 22:06:38.405660 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 319/605] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:38 2022] GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976 => generated 1370 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:06:38.531890 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-4279a5eb-7772-404d-8a5c-2bfc02f69a43 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:38.540049 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-4279a5eb-7772-404d-8a5c-2bfc02f69a43 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f" status: 200 len: 1279 microversion: 2.1 time: 0.151431 Jun 07 22:06:38.540908 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 287/606] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:38 2022] GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f => generated 1279 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:39.250786 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-b0e5fa93-9498-4eee-af5f-6fba081bc81b tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:39.251430 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-b0e5fa93-9498-4eee-af5f-6fba081bc81b tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:39.258937 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b0e5fa93-9498-4eee-af5f-6fba081bc81b tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:39.259399 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b0e5fa93-9498-4eee-af5f-6fba081bc81b tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:39.260148 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b0e5fa93-9498-4eee-af5f-6fba081bc81b tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:39.260577 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b0e5fa93-9498-4eee-af5f-6fba081bc81b tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:39.387180 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-b0e5fa93-9498-4eee-af5f-6fba081bc81b tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af02cd6ffd0484c8f6569629cd6313c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31cd38d46643fbac516d21ee4f89ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:39.394543 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-b0e5fa93-9498-4eee-af5f-6fba081bc81b tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b" status: 200 len: 1357 microversion: 2.1 time: 0.147613 Jun 07 22:06:39.395092 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 320/607] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:39 2022] GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b => generated 1357 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:39.404180 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-a591a64a-31e4-4037-a370-3d4dbe11d710 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:39.404782 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-a591a64a-31e4-4037-a370-3d4dbe11d710 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 51fd7e4e-4aea-426f-ae93-cd9dde475a9b] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:39.406740 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_cell0:SELECT=2 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:06:39.407408 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_cell0:SELECT=6 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:06:39.413577 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a591a64a-31e4-4037-a370-3d4dbe11d710 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:39.414025 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a591a64a-31e4-4037-a370-3d4dbe11d710 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:39.414782 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a591a64a-31e4-4037-a370-3d4dbe11d710 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:39.415213 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a591a64a-31e4-4037-a370-3d4dbe11d710 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:39.418090 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-905aab59-055d-43d7-ad54-3a6cdba6a21e tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:39.418692 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-905aab59-055d-43d7-ad54-3a6cdba6a21e tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: f84b4686-8e5c-49af-b5ad-13f37e20f976] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:39.424554 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-905aab59-055d-43d7-ad54-3a6cdba6a21e tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:39.424996 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-905aab59-055d-43d7-ad54-3a6cdba6a21e tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:39.425742 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-905aab59-055d-43d7-ad54-3a6cdba6a21e tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:39.426173 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-905aab59-055d-43d7-ad54-3a6cdba6a21e tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:39.426706 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_cell0:SELECT=2 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:06:39.545088 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-a591a64a-31e4-4037-a370-3d4dbe11d710 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce9ec4aea9449d3890f6dbb93f97968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc558dd3848d4d3d950d7cd408e19741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:39.552659 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-a591a64a-31e4-4037-a370-3d4dbe11d710 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b" status: 200 len: 1503 microversion: 2.1 time: 0.152308 Jun 07 22:06:39.553369 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 288/608] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:39 2022] GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b => generated 1503 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:39.555025 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-905aab59-055d-43d7-ad54-3a6cdba6a21e tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:39.557899 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-003561e2-3d12-4683-8f57-5a116a1d920f tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:39.558507 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-003561e2-3d12-4683-8f57-5a116a1d920f tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: c2ece8dd-91fb-472c-b0c7-970ee215412f] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:39.565126 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-003561e2-3d12-4683-8f57-5a116a1d920f tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:39.565621 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-003561e2-3d12-4683-8f57-5a116a1d920f tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:39.566347 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-905aab59-055d-43d7-ad54-3a6cdba6a21e tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976" status: 200 len: 1370 microversion: 2.1 time: 0.151891 Jun 07 22:06:39.566481 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-003561e2-3d12-4683-8f57-5a116a1d920f tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:39.566941 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-003561e2-3d12-4683-8f57-5a116a1d920f tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:39.576414 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 321/609] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:39 2022] GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976 => generated 1370 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:06:39.698324 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-003561e2-3d12-4683-8f57-5a116a1d920f tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:39.706376 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-003561e2-3d12-4683-8f57-5a116a1d920f tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f" status: 200 len: 1279 microversion: 2.1 time: 0.152074 Jun 07 22:06:39.706935 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 289/610] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:39 2022] GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f => generated 1279 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:40.411430 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-f5f8f7ef-bd91-4653-b194-030d867e55aa tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:40.412045 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-f5f8f7ef-bd91-4653-b194-030d867e55aa tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:40.415036 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_api:SELECT=100 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:06:40.420680 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-f5f8f7ef-bd91-4653-b194-030d867e55aa tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:40.421131 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-f5f8f7ef-bd91-4653-b194-030d867e55aa tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:40.421891 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-f5f8f7ef-bd91-4653-b194-030d867e55aa tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:40.422328 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-f5f8f7ef-bd91-4653-b194-030d867e55aa tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:40.546723 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-f5f8f7ef-bd91-4653-b194-030d867e55aa tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af02cd6ffd0484c8f6569629cd6313c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31cd38d46643fbac516d21ee4f89ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:40.554864 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-f5f8f7ef-bd91-4653-b194-030d867e55aa tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b" status: 200 len: 1357 microversion: 2.1 time: 0.147381 Jun 07 22:06:40.555454 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 322/611] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:40 2022] GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b => generated 1357 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:40.570119 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-6320a2e1-97af-495c-bfde-fad03ab5a7bd tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:40.570719 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-6320a2e1-97af-495c-bfde-fad03ab5a7bd tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 51fd7e4e-4aea-426f-ae93-cd9dde475a9b] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:40.576659 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6320a2e1-97af-495c-bfde-fad03ab5a7bd tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:40.577122 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6320a2e1-97af-495c-bfde-fad03ab5a7bd tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:40.577863 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6320a2e1-97af-495c-bfde-fad03ab5a7bd tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:40.578281 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6320a2e1-97af-495c-bfde-fad03ab5a7bd tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:40.583320 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-339ab484-a1ad-4703-855b-7dd28601700b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:40.583954 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-339ab484-a1ad-4703-855b-7dd28601700b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: f84b4686-8e5c-49af-b5ad-13f37e20f976] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:40.590171 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-339ab484-a1ad-4703-855b-7dd28601700b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:40.590616 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-339ab484-a1ad-4703-855b-7dd28601700b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:40.591500 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-339ab484-a1ad-4703-855b-7dd28601700b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:40.591844 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-339ab484-a1ad-4703-855b-7dd28601700b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:40.709818 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-6320a2e1-97af-495c-bfde-fad03ab5a7bd tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce9ec4aea9449d3890f6dbb93f97968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc558dd3848d4d3d950d7cd408e19741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:40.717767 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-6320a2e1-97af-495c-bfde-fad03ab5a7bd tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b" status: 200 len: 1503 microversion: 2.1 time: 0.151700 Jun 07 22:06:40.718515 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 290/612] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:40 2022] GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b => generated 1503 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:40.726751 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-339ab484-a1ad-4703-855b-7dd28601700b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:40.730885 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-0fef2bbd-1373-42ad-9561-7ed0a73bca93 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:40.731539 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-0fef2bbd-1373-42ad-9561-7ed0a73bca93 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: c2ece8dd-91fb-472c-b0c7-970ee215412f] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:40.734281 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-339ab484-a1ad-4703-855b-7dd28601700b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976" status: 200 len: 1370 microversion: 2.1 time: 0.154662 Jun 07 22:06:40.734836 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 323/613] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:40 2022] GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976 => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:06:40.737638 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0fef2bbd-1373-42ad-9561-7ed0a73bca93 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:40.738099 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0fef2bbd-1373-42ad-9561-7ed0a73bca93 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:40.738839 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0fef2bbd-1373-42ad-9561-7ed0a73bca93 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:40.739274 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0fef2bbd-1373-42ad-9561-7ed0a73bca93 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:40.868533 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-0fef2bbd-1373-42ad-9561-7ed0a73bca93 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:40.875946 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-0fef2bbd-1373-42ad-9561-7ed0a73bca93 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f" status: 200 len: 1279 microversion: 2.1 time: 0.149010 Jun 07 22:06:40.876561 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 291/614] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:40 2022] GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f => generated 1279 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:41.572407 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-fc22874c-c8a7-44cb-9528-e467b4880603 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:41.573016 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-fc22874c-c8a7-44cb-9528-e467b4880603 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:41.579506 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-fc22874c-c8a7-44cb-9528-e467b4880603 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:41.579958 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-fc22874c-c8a7-44cb-9528-e467b4880603 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:41.580712 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-fc22874c-c8a7-44cb-9528-e467b4880603 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:41.581141 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-fc22874c-c8a7-44cb-9528-e467b4880603 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:41.706102 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-fc22874c-c8a7-44cb-9528-e467b4880603 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af02cd6ffd0484c8f6569629cd6313c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31cd38d46643fbac516d21ee4f89ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:41.713747 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-fc22874c-c8a7-44cb-9528-e467b4880603 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b" status: 200 len: 1357 microversion: 2.1 time: 0.145994 Jun 07 22:06:41.714607 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 324/615] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:41 2022] GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b => generated 1357 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:41.735759 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-18bb5b24-c4a0-4162-b4fd-fbb13d3ef721 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:41.736366 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-18bb5b24-c4a0-4162-b4fd-fbb13d3ef721 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 51fd7e4e-4aea-426f-ae93-cd9dde475a9b] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:41.743090 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-18bb5b24-c4a0-4162-b4fd-fbb13d3ef721 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:41.743582 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-18bb5b24-c4a0-4162-b4fd-fbb13d3ef721 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:41.744332 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-18bb5b24-c4a0-4162-b4fd-fbb13d3ef721 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:41.744765 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-18bb5b24-c4a0-4162-b4fd-fbb13d3ef721 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:41.749505 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-e5b28767-1d38-4207-89f2-8337b3e3f977 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:41.750110 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-e5b28767-1d38-4207-89f2-8337b3e3f977 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: f84b4686-8e5c-49af-b5ad-13f37e20f976] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:41.756875 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e5b28767-1d38-4207-89f2-8337b3e3f977 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:41.757415 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e5b28767-1d38-4207-89f2-8337b3e3f977 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:41.758267 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e5b28767-1d38-4207-89f2-8337b3e3f977 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:41.758781 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e5b28767-1d38-4207-89f2-8337b3e3f977 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:41.887681 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-18bb5b24-c4a0-4162-b4fd-fbb13d3ef721 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce9ec4aea9449d3890f6dbb93f97968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc558dd3848d4d3d950d7cd408e19741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:41.896547 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-18bb5b24-c4a0-4162-b4fd-fbb13d3ef721 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b" status: 200 len: 1503 microversion: 2.1 time: 0.164436 Jun 07 22:06:41.897674 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 292/616] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:41 2022] GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b => generated 1503 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:41.901458 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-e5b28767-1d38-4207-89f2-8337b3e3f977 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:41.909479 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-e5b28767-1d38-4207-89f2-8337b3e3f977 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976" status: 200 len: 1370 microversion: 2.1 time: 0.163613 Jun 07 22:06:41.910045 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 325/617] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:41 2022] GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976 => generated 1370 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:06:41.911115 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-d6799da8-2e01-407c-9415-4cb63d81cf70 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:41.911742 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-d6799da8-2e01-407c-9415-4cb63d81cf70 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: c2ece8dd-91fb-472c-b0c7-970ee215412f] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:41.918358 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d6799da8-2e01-407c-9415-4cb63d81cf70 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:41.918796 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d6799da8-2e01-407c-9415-4cb63d81cf70 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:41.919585 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d6799da8-2e01-407c-9415-4cb63d81cf70 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:41.920019 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d6799da8-2e01-407c-9415-4cb63d81cf70 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:42.131375 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-d6799da8-2e01-407c-9415-4cb63d81cf70 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:42.138792 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-d6799da8-2e01-407c-9415-4cb63d81cf70 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f" status: 200 len: 1279 microversion: 2.1 time: 0.231338 Jun 07 22:06:42.139374 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 293/618] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:41 2022] GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f => generated 1279 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:42.664271 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [req-4b559cd9-ff3d-4396-b865-cb327d9539bf req-e9df4b8e-e9e2-44b7-90d1-6b75ff727afa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2ece8dd-91fb-472c-b0c7-970ee215412f", "tag": "cd305cc0-e94a-48c1-a7dc-703d1a53df17"}]} {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:06:42.675207 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-4b559cd9-ff3d-4396-b865-cb327d9539bf req-e9df4b8e-e9e2-44b7-90d1-6b75ff727afa service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:42.680911 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-4b559cd9-ff3d-4396-b865-cb327d9539bf req-e9df4b8e-e9e2-44b7-90d1-6b75ff727afa service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:42.699775 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.compute.server_external_events [req-4b559cd9-ff3d-4396-b865-cb327d9539bf req-e9df4b8e-e9e2-44b7-90d1-6b75ff727afa service nova] Creating event network-changed:cd305cc0-e94a-48c1-a7dc-703d1a53df17 for instance c2ece8dd-91fb-472c-b0c7-970ee215412f on hv-cinder-83552 Jun 07 22:06:42.704693 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [req-4b559cd9-ff3d-4396-b865-cb327d9539bf req-e9df4b8e-e9e2-44b7-90d1-6b75ff727afa service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044987 Jun 07 22:06:42.705278 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 326/619] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:06:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:06:42.731041 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-0a7fcda2-8429-449e-9fb6-64edd0782239 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:42.731681 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-0a7fcda2-8429-449e-9fb6-64edd0782239 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:42.738133 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0a7fcda2-8429-449e-9fb6-64edd0782239 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:42.738741 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0a7fcda2-8429-449e-9fb6-64edd0782239 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:42.739368 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0a7fcda2-8429-449e-9fb6-64edd0782239 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:42.739808 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0a7fcda2-8429-449e-9fb6-64edd0782239 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:42.891271 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-0a7fcda2-8429-449e-9fb6-64edd0782239 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af02cd6ffd0484c8f6569629cd6313c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31cd38d46643fbac516d21ee4f89ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:42.905291 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-0a7fcda2-8429-449e-9fb6-64edd0782239 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b" status: 200 len: 1357 microversion: 2.1 time: 0.177860 Jun 07 22:06:42.906002 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 294/620] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:42 2022] GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b => generated 1357 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:42.915517 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-5149cf25-266a-44fb-8904-ccad58e2ec2f tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:42.916417 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-5149cf25-266a-44fb-8904-ccad58e2ec2f tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 51fd7e4e-4aea-426f-ae93-cd9dde475a9b] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:42.926069 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-c43f41bf-7f64-419e-a0d3-b570f3440192 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:42.926658 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-c43f41bf-7f64-419e-a0d3-b570f3440192 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: f84b4686-8e5c-49af-b5ad-13f37e20f976] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:42.927157 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-5149cf25-266a-44fb-8904-ccad58e2ec2f tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:42.928200 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-5149cf25-266a-44fb-8904-ccad58e2ec2f tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:42.928993 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-5149cf25-266a-44fb-8904-ccad58e2ec2f tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:42.929419 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-5149cf25-266a-44fb-8904-ccad58e2ec2f tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:42.933414 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c43f41bf-7f64-419e-a0d3-b570f3440192 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:42.933863 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c43f41bf-7f64-419e-a0d3-b570f3440192 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:42.934623 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c43f41bf-7f64-419e-a0d3-b570f3440192 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:42.935059 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c43f41bf-7f64-419e-a0d3-b570f3440192 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:43.070158 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-5149cf25-266a-44fb-8904-ccad58e2ec2f tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce9ec4aea9449d3890f6dbb93f97968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc558dd3848d4d3d950d7cd408e19741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:43.070347 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-c43f41bf-7f64-419e-a0d3-b570f3440192 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:43.077807 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-5149cf25-266a-44fb-8904-ccad58e2ec2f tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b" status: 200 len: 1503 microversion: 2.1 time: 0.167568 Jun 07 22:06:43.078034 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-c43f41bf-7f64-419e-a0d3-b570f3440192 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976" status: 200 len: 1370 microversion: 2.1 time: 0.155631 Jun 07 22:06:43.078785 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 327/621] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:42 2022] GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b => generated 1503 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:43.078920 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 295/622] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:42 2022] GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976 => generated 1370 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:43.156348 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-052b4203-9626-4621-b0e9-37d2757e2432 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:43.156904 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-052b4203-9626-4621-b0e9-37d2757e2432 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: c2ece8dd-91fb-472c-b0c7-970ee215412f] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:43.163176 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-052b4203-9626-4621-b0e9-37d2757e2432 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:43.163660 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-052b4203-9626-4621-b0e9-37d2757e2432 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:43.164420 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-052b4203-9626-4621-b0e9-37d2757e2432 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:43.164858 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-052b4203-9626-4621-b0e9-37d2757e2432 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:43.308219 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-052b4203-9626-4621-b0e9-37d2757e2432 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:43.315647 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-052b4203-9626-4621-b0e9-37d2757e2432 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f" status: 200 len: 1279 microversion: 2.1 time: 0.163300 Jun 07 22:06:43.316238 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 328/623] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:43 2022] GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f => generated 1279 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:43.922402 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-3e94bfcb-dcf9-4014-baf4-d46b793cbc49 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:43.923020 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-3e94bfcb-dcf9-4014-baf4-d46b793cbc49 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:43.929928 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-3e94bfcb-dcf9-4014-baf4-d46b793cbc49 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:43.930379 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-3e94bfcb-dcf9-4014-baf4-d46b793cbc49 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:43.931154 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-3e94bfcb-dcf9-4014-baf4-d46b793cbc49 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:43.931616 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-3e94bfcb-dcf9-4014-baf4-d46b793cbc49 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:43.947114 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:06:44.066409 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-3e94bfcb-dcf9-4014-baf4-d46b793cbc49 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af02cd6ffd0484c8f6569629cd6313c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31cd38d46643fbac516d21ee4f89ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:44.076189 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-3e94bfcb-dcf9-4014-baf4-d46b793cbc49 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b" status: 200 len: 1357 microversion: 2.1 time: 0.157975 Jun 07 22:06:44.087093 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 296/624] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:43 2022] GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:06:44.095028 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-f6e20ede-2755-47e1-aa54-7669a13cd09c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:44.096122 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-f6e20ede-2755-47e1-aa54-7669a13cd09c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: f84b4686-8e5c-49af-b5ad-13f37e20f976] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:44.100462 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-46ba6b5b-f4ea-4d76-9d97-1b8d433034c5 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:44.102387 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-46ba6b5b-f4ea-4d76-9d97-1b8d433034c5 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 51fd7e4e-4aea-426f-ae93-cd9dde475a9b] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:44.103554 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-f6e20ede-2755-47e1-aa54-7669a13cd09c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:44.104014 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-f6e20ede-2755-47e1-aa54-7669a13cd09c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:44.104788 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-f6e20ede-2755-47e1-aa54-7669a13cd09c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:44.105255 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-f6e20ede-2755-47e1-aa54-7669a13cd09c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:44.112290 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-46ba6b5b-f4ea-4d76-9d97-1b8d433034c5 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:44.112889 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-46ba6b5b-f4ea-4d76-9d97-1b8d433034c5 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:44.113725 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-46ba6b5b-f4ea-4d76-9d97-1b8d433034c5 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:44.114246 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-46ba6b5b-f4ea-4d76-9d97-1b8d433034c5 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:44.238339 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-f6e20ede-2755-47e1-aa54-7669a13cd09c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:44.242075 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_cell1:SELECT=100 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:06:44.243579 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-46ba6b5b-f4ea-4d76-9d97-1b8d433034c5 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce9ec4aea9449d3890f6dbb93f97968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc558dd3848d4d3d950d7cd408e19741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:44.247194 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-f6e20ede-2755-47e1-aa54-7669a13cd09c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976" status: 200 len: 1370 microversion: 2.1 time: 0.155886 Jun 07 22:06:44.247798 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 329/625] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:44 2022] GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976 => generated 1370 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:44.251089 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-46ba6b5b-f4ea-4d76-9d97-1b8d433034c5 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b" status: 200 len: 1503 microversion: 2.1 time: 0.159176 Jun 07 22:06:44.251675 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 297/626] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:44 2022] GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b => generated 1503 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:44.332418 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-29c1b9c0-6896-4fd8-8bf7-04c7e9488854 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:44.333025 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-29c1b9c0-6896-4fd8-8bf7-04c7e9488854 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: c2ece8dd-91fb-472c-b0c7-970ee215412f] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:44.339943 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-29c1b9c0-6896-4fd8-8bf7-04c7e9488854 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:44.340388 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-29c1b9c0-6896-4fd8-8bf7-04c7e9488854 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:44.341139 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-29c1b9c0-6896-4fd8-8bf7-04c7e9488854 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:44.341607 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-29c1b9c0-6896-4fd8-8bf7-04c7e9488854 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:44.469973 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-29c1b9c0-6896-4fd8-8bf7-04c7e9488854 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:44.477709 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-29c1b9c0-6896-4fd8-8bf7-04c7e9488854 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f" status: 200 len: 1279 microversion: 2.1 time: 0.149078 Jun 07 22:06:44.478274 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 330/627] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:44 2022] GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f => generated 1279 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:45.094109 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-8539a7b4-2d62-4e04-ae71-6e5c338a6b52 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:45.094736 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-8539a7b4-2d62-4e04-ae71-6e5c338a6b52 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:45.101772 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-8539a7b4-2d62-4e04-ae71-6e5c338a6b52 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:45.102218 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-8539a7b4-2d62-4e04-ae71-6e5c338a6b52 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:45.102966 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-8539a7b4-2d62-4e04-ae71-6e5c338a6b52 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:45.103434 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-8539a7b4-2d62-4e04-ae71-6e5c338a6b52 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:45.240778 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-8539a7b4-2d62-4e04-ae71-6e5c338a6b52 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af02cd6ffd0484c8f6569629cd6313c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31cd38d46643fbac516d21ee4f89ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:45.248077 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-8539a7b4-2d62-4e04-ae71-6e5c338a6b52 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b" status: 200 len: 1357 microversion: 2.1 time: 0.157845 Jun 07 22:06:45.248641 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 298/628] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:45 2022] GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:45.265558 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-f6e0b1b3-5ab6-4ac4-9f29-4c5e42bd21b4 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:45.266173 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-f6e0b1b3-5ab6-4ac4-9f29-4c5e42bd21b4 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: f84b4686-8e5c-49af-b5ad-13f37e20f976] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:45.268078 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-4c648cd5-9344-4403-a938-e2d29946308b tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:45.268686 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-4c648cd5-9344-4403-a938-e2d29946308b tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 51fd7e4e-4aea-426f-ae93-cd9dde475a9b] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:45.273362 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-f6e0b1b3-5ab6-4ac4-9f29-4c5e42bd21b4 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:45.273817 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-f6e0b1b3-5ab6-4ac4-9f29-4c5e42bd21b4 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:45.274587 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-f6e0b1b3-5ab6-4ac4-9f29-4c5e42bd21b4 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:45.275025 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-f6e0b1b3-5ab6-4ac4-9f29-4c5e42bd21b4 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:45.275345 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4c648cd5-9344-4403-a938-e2d29946308b tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:45.275803 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4c648cd5-9344-4403-a938-e2d29946308b tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:45.276557 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4c648cd5-9344-4403-a938-e2d29946308b tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:45.277015 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4c648cd5-9344-4403-a938-e2d29946308b tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:45.407040 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-4c648cd5-9344-4403-a938-e2d29946308b tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce9ec4aea9449d3890f6dbb93f97968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc558dd3848d4d3d950d7cd408e19741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:45.411691 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-f6e0b1b3-5ab6-4ac4-9f29-4c5e42bd21b4 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:45.415803 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-4c648cd5-9344-4403-a938-e2d29946308b tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b" status: 200 len: 1503 microversion: 2.1 time: 0.151202 Jun 07 22:06:45.416381 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 299/629] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:45 2022] GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b => generated 1503 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:06:45.420174 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-f6e0b1b3-5ab6-4ac4-9f29-4c5e42bd21b4 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976" status: 200 len: 1370 microversion: 2.1 time: 0.158735 Jun 07 22:06:45.420796 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 331/630] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:45 2022] GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976 => generated 1370 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:45.494470 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-9f5ae99c-38bf-45c0-90af-aed5952ce8d8 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:45.495091 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-9f5ae99c-38bf-45c0-90af-aed5952ce8d8 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: c2ece8dd-91fb-472c-b0c7-970ee215412f] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:45.501142 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-9f5ae99c-38bf-45c0-90af-aed5952ce8d8 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:45.501587 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-9f5ae99c-38bf-45c0-90af-aed5952ce8d8 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:45.502334 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-9f5ae99c-38bf-45c0-90af-aed5952ce8d8 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:45.502769 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-9f5ae99c-38bf-45c0-90af-aed5952ce8d8 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:45.634915 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-9f5ae99c-38bf-45c0-90af-aed5952ce8d8 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:45.642303 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-9f5ae99c-38bf-45c0-90af-aed5952ce8d8 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f" status: 200 len: 1279 microversion: 2.1 time: 0.151733 Jun 07 22:06:45.642893 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 300/631] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:45 2022] GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f => generated 1279 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:46.264195 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-4002ec5d-d5e9-4afb-9b83-4061f3a68968 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:46.264806 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-4002ec5d-d5e9-4afb-9b83-4061f3a68968 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:46.271235 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-4002ec5d-d5e9-4afb-9b83-4061f3a68968 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:46.271839 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-4002ec5d-d5e9-4afb-9b83-4061f3a68968 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:46.272553 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-4002ec5d-d5e9-4afb-9b83-4061f3a68968 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:46.273101 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-4002ec5d-d5e9-4afb-9b83-4061f3a68968 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:46.398548 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-4002ec5d-d5e9-4afb-9b83-4061f3a68968 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af02cd6ffd0484c8f6569629cd6313c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31cd38d46643fbac516d21ee4f89ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:46.405814 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-4002ec5d-d5e9-4afb-9b83-4061f3a68968 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b" status: 200 len: 1357 microversion: 2.1 time: 0.145470 Jun 07 22:06:46.406378 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 332/632] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:46 2022] GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b => generated 1357 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:46.434305 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-a0208c3e-c0f4-4f54-9939-7afe9566a127 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:46.434990 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-a0208c3e-c0f4-4f54-9939-7afe9566a127 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 51fd7e4e-4aea-426f-ae93-cd9dde475a9b] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:46.439439 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-c86b4f0c-9e3b-4a98-8c77-c48b203dbb15 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:46.440056 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-c86b4f0c-9e3b-4a98-8c77-c48b203dbb15 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: f84b4686-8e5c-49af-b5ad-13f37e20f976] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:46.441247 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a0208c3e-c0f4-4f54-9939-7afe9566a127 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:46.441692 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a0208c3e-c0f4-4f54-9939-7afe9566a127 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:46.442449 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a0208c3e-c0f4-4f54-9939-7afe9566a127 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:46.442882 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a0208c3e-c0f4-4f54-9939-7afe9566a127 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:46.447897 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c86b4f0c-9e3b-4a98-8c77-c48b203dbb15 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:46.448356 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c86b4f0c-9e3b-4a98-8c77-c48b203dbb15 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:46.449128 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c86b4f0c-9e3b-4a98-8c77-c48b203dbb15 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:46.449594 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c86b4f0c-9e3b-4a98-8c77-c48b203dbb15 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:46.574038 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-a0208c3e-c0f4-4f54-9939-7afe9566a127 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce9ec4aea9449d3890f6dbb93f97968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc558dd3848d4d3d950d7cd408e19741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:46.581763 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-a0208c3e-c0f4-4f54-9939-7afe9566a127 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b" status: 200 len: 1503 microversion: 2.1 time: 0.151750 Jun 07 22:06:46.582364 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 301/633] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:46 2022] GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b => generated 1503 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:46.585924 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-c86b4f0c-9e3b-4a98-8c77-c48b203dbb15 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:46.593475 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-c86b4f0c-9e3b-4a98-8c77-c48b203dbb15 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976" status: 200 len: 1370 microversion: 2.1 time: 0.159587 Jun 07 22:06:46.594033 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 333/634] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:46 2022] GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976 => generated 1370 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:46.659538 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-de3d86ef-ccaf-4a2a-a242-f440b5d13a5c tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:46.660115 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-de3d86ef-ccaf-4a2a-a242-f440b5d13a5c tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: c2ece8dd-91fb-472c-b0c7-970ee215412f] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:46.666595 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-de3d86ef-ccaf-4a2a-a242-f440b5d13a5c tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:46.667041 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-de3d86ef-ccaf-4a2a-a242-f440b5d13a5c tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:46.667821 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-de3d86ef-ccaf-4a2a-a242-f440b5d13a5c tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:46.668249 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-de3d86ef-ccaf-4a2a-a242-f440b5d13a5c tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:46.804523 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-de3d86ef-ccaf-4a2a-a242-f440b5d13a5c tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:46.811858 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-de3d86ef-ccaf-4a2a-a242-f440b5d13a5c tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f" status: 200 len: 1279 microversion: 2.1 time: 0.156203 Jun 07 22:06:46.812419 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 302/635] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:46 2022] GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f => generated 1279 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:47.423076 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-879d53e6-d1cf-4284-9e74-848b7272ad51 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:47.423660 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-879d53e6-d1cf-4284-9e74-848b7272ad51 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:47.430700 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-879d53e6-d1cf-4284-9e74-848b7272ad51 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:47.431142 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-879d53e6-d1cf-4284-9e74-848b7272ad51 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:47.431927 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-879d53e6-d1cf-4284-9e74-848b7272ad51 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:47.432360 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-879d53e6-d1cf-4284-9e74-848b7272ad51 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:47.558225 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-879d53e6-d1cf-4284-9e74-848b7272ad51 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af02cd6ffd0484c8f6569629cd6313c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31cd38d46643fbac516d21ee4f89ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:47.566809 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-879d53e6-d1cf-4284-9e74-848b7272ad51 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b" status: 200 len: 1357 microversion: 2.1 time: 0.147716 Jun 07 22:06:47.567391 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 334/636] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:47 2022] GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b => generated 1357 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:47.597829 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-8d59c8b2-8538-47c1-a9b9-dde70ac89ed7 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:47.598542 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-8d59c8b2-8538-47c1-a9b9-dde70ac89ed7 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 51fd7e4e-4aea-426f-ae93-cd9dde475a9b] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:47.605576 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-8d59c8b2-8538-47c1-a9b9-dde70ac89ed7 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:47.606020 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-8d59c8b2-8538-47c1-a9b9-dde70ac89ed7 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:47.606768 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-8d59c8b2-8538-47c1-a9b9-dde70ac89ed7 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:47.607361 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-8d59c8b2-8538-47c1-a9b9-dde70ac89ed7 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:47.609892 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-be0d2b99-a181-4d64-b448-ef33e30d8a4b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:47.610537 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-be0d2b99-a181-4d64-b448-ef33e30d8a4b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: f84b4686-8e5c-49af-b5ad-13f37e20f976] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:47.616545 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-be0d2b99-a181-4d64-b448-ef33e30d8a4b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:47.616997 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-be0d2b99-a181-4d64-b448-ef33e30d8a4b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:47.617760 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-be0d2b99-a181-4d64-b448-ef33e30d8a4b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:47.618235 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-be0d2b99-a181-4d64-b448-ef33e30d8a4b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:47.743373 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-8d59c8b2-8538-47c1-a9b9-dde70ac89ed7 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce9ec4aea9449d3890f6dbb93f97968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc558dd3848d4d3d950d7cd408e19741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:47.750141 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-be0d2b99-a181-4d64-b448-ef33e30d8a4b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:47.750781 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-8d59c8b2-8538-47c1-a9b9-dde70ac89ed7 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b" status: 200 len: 1503 microversion: 2.1 time: 0.156768 Jun 07 22:06:47.751377 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 303/637] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:47 2022] GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b => generated 1503 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:47.761724 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-be0d2b99-a181-4d64-b448-ef33e30d8a4b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976" status: 200 len: 1370 microversion: 2.1 time: 0.155476 Jun 07 22:06:47.762323 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 335/638] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:47 2022] GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976 => generated 1370 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:06:47.828725 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-0bd265d1-aa7e-4157-95ac-55241e85b1e9 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:47.829379 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-0bd265d1-aa7e-4157-95ac-55241e85b1e9 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: c2ece8dd-91fb-472c-b0c7-970ee215412f] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:47.836146 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0bd265d1-aa7e-4157-95ac-55241e85b1e9 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:47.836587 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0bd265d1-aa7e-4157-95ac-55241e85b1e9 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:47.837328 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0bd265d1-aa7e-4157-95ac-55241e85b1e9 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:47.837753 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0bd265d1-aa7e-4157-95ac-55241e85b1e9 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:47.965180 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-0bd265d1-aa7e-4157-95ac-55241e85b1e9 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:47.972686 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-0bd265d1-aa7e-4157-95ac-55241e85b1e9 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f" status: 200 len: 1279 microversion: 2.1 time: 0.147761 Jun 07 22:06:47.973247 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 304/639] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:47 2022] GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f => generated 1279 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:48.583320 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-5c2db6bb-ec30-4bea-ba4c-29e4a5de72fa tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:48.583947 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-5c2db6bb-ec30-4bea-ba4c-29e4a5de72fa tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:48.590429 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-5c2db6bb-ec30-4bea-ba4c-29e4a5de72fa tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:48.590876 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-5c2db6bb-ec30-4bea-ba4c-29e4a5de72fa tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:48.591691 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-5c2db6bb-ec30-4bea-ba4c-29e4a5de72fa tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:48.592125 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-5c2db6bb-ec30-4bea-ba4c-29e4a5de72fa tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:48.727284 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-5c2db6bb-ec30-4bea-ba4c-29e4a5de72fa tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af02cd6ffd0484c8f6569629cd6313c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31cd38d46643fbac516d21ee4f89ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:48.734660 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-5c2db6bb-ec30-4bea-ba4c-29e4a5de72fa tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b" status: 200 len: 1357 microversion: 2.1 time: 0.155218 Jun 07 22:06:48.735228 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 336/640] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:48 2022] GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:48.767782 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-f551063f-4c45-4060-910f-91d21f20b68d tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:48.768398 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-f551063f-4c45-4060-910f-91d21f20b68d tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 51fd7e4e-4aea-426f-ae93-cd9dde475a9b] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:48.775475 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f551063f-4c45-4060-910f-91d21f20b68d tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:48.775944 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f551063f-4c45-4060-910f-91d21f20b68d tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:48.776693 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f551063f-4c45-4060-910f-91d21f20b68d tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:48.777173 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f551063f-4c45-4060-910f-91d21f20b68d tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:48.779096 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-a55e431b-dca2-49b9-8e5f-6a8be95f2e43 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:48.779807 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-a55e431b-dca2-49b9-8e5f-6a8be95f2e43 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: f84b4686-8e5c-49af-b5ad-13f37e20f976] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:48.786400 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a55e431b-dca2-49b9-8e5f-6a8be95f2e43 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:48.787385 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a55e431b-dca2-49b9-8e5f-6a8be95f2e43 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:48.788148 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a55e431b-dca2-49b9-8e5f-6a8be95f2e43 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:48.788585 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a55e431b-dca2-49b9-8e5f-6a8be95f2e43 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:48.915959 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-f551063f-4c45-4060-910f-91d21f20b68d tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce9ec4aea9449d3890f6dbb93f97968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc558dd3848d4d3d950d7cd408e19741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:48.923268 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-a55e431b-dca2-49b9-8e5f-6a8be95f2e43 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:48.924537 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-f551063f-4c45-4060-910f-91d21f20b68d tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b" status: 200 len: 1503 microversion: 2.1 time: 0.160606 Jun 07 22:06:48.925210 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 305/641] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:48 2022] GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b => generated 1503 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:48.931955 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-a55e431b-dca2-49b9-8e5f-6a8be95f2e43 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976" status: 200 len: 1370 microversion: 2.1 time: 0.157075 Jun 07 22:06:48.932509 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 337/642] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:48 2022] GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976 => generated 1370 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:06:48.989673 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-966dfcac-69a8-4647-9fa1-23f0e8f0c46a tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:48.990353 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-966dfcac-69a8-4647-9fa1-23f0e8f0c46a tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: c2ece8dd-91fb-472c-b0c7-970ee215412f] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:48.996336 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-966dfcac-69a8-4647-9fa1-23f0e8f0c46a tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:48.996782 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-966dfcac-69a8-4647-9fa1-23f0e8f0c46a tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:48.997535 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-966dfcac-69a8-4647-9fa1-23f0e8f0c46a tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:48.997971 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-966dfcac-69a8-4647-9fa1-23f0e8f0c46a tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:49.126939 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-966dfcac-69a8-4647-9fa1-23f0e8f0c46a tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:49.134443 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-966dfcac-69a8-4647-9fa1-23f0e8f0c46a tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f" status: 200 len: 1279 microversion: 2.1 time: 0.148575 Jun 07 22:06:49.135005 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 306/643] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:48 2022] GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f => generated 1279 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:49.362005 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-aa5a6b55-9f69-435b-8f4d-e550639d5df8 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-966329538", "imageRef": "87e2e140-6de8-4531-9681-d0a3e069622d", "flavorRef": "452", "networks": [{"uuid": "237bd539-264c-42b8-aec5-0f36574ea98d"}]}} {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:06:49.433435 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.network.neutron [None req-aa5a6b55-9f69-435b-8f4d-e550639d5df8 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] validate_networks() for [('237bd539-264c-42b8-aec5-0f36574ea98d', None, None, None, None, None)] {{(pid=117971) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 22:06:49.752286 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-7349ba6b-2d36-492a-8f01-da1333cf4fd1 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:49.757603 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-7349ba6b-2d36-492a-8f01-da1333cf4fd1 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:49.759203 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-7349ba6b-2d36-492a-8f01-da1333cf4fd1 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:49.759683 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-7349ba6b-2d36-492a-8f01-da1333cf4fd1 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:49.760531 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-7349ba6b-2d36-492a-8f01-da1333cf4fd1 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:49.760885 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-7349ba6b-2d36-492a-8f01-da1333cf4fd1 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:50.076088 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.virt.hardware [None req-aa5a6b55-9f69-435b-8f4d-e550639d5df8 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Flavor limits 0:0:0 {{(pid=117971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 22:06:50.076611 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.virt.hardware [None req-aa5a6b55-9f69-435b-8f4d-e550639d5df8 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Image limits 0:0:0 {{(pid=117971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 22:06:50.076954 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.virt.hardware [None req-aa5a6b55-9f69-435b-8f4d-e550639d5df8 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Flavor pref 0:0:0 {{(pid=117971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 22:06:50.077380 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.virt.hardware [None req-aa5a6b55-9f69-435b-8f4d-e550639d5df8 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Image pref 0:0:0 {{(pid=117971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 22:06:50.077784 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.virt.hardware [None req-aa5a6b55-9f69-435b-8f4d-e550639d5df8 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 22:06:50.089199 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-aa5a6b55-9f69-435b-8f4d-e550639d5df8 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:50.089635 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-aa5a6b55-9f69-435b-8f4d-e550639d5df8 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:50.090448 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-aa5a6b55-9f69-435b-8f4d-e550639d5df8 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:50.090878 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-aa5a6b55-9f69-435b-8f4d-e550639d5df8 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:50.109186 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.quota [None req-aa5a6b55-9f69-435b-8f4d-e550639d5df8 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Getting quotas for project d3b84dd581fc4e9499cfecbb7242e3b3. Resources: {'cores', 'ram', 'instances'} {{(pid=117971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 22:06:50.113420 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.quota [None req-aa5a6b55-9f69-435b-8f4d-e550639d5df8 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Getting quotas for user fa4fc7744b3d4e5fb6e281fcc90cef5e and project d3b84dd581fc4e9499cfecbb7242e3b3. Resources: {'cores', 'ram', 'instances'} {{(pid=117971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 22:06:50.125604 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-aa5a6b55-9f69-435b-8f4d-e550639d5df8 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Going to run 1 instances... {{(pid=117971) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 22:06:50.127917 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-aa5a6b55-9f69-435b-8f4d-e550639d5df8 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] [instance: 706597ea-671a-4be9-bfda-9ce6e1cfcf30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='87e2e140-6de8-4531-9681-d0a3e069622d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 22:06:50.175568 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-aa5a6b55-9f69-435b-8f4d-e550639d5df8 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.818155 Jun 07 22:06:50.176485 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 338/644] 10.222.0.13 () {60 vars in 1146 bytes} [Tue Jun 7 22:06:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 820 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 22:06:50.187055 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-c8037453-e474-4de3-a18e-09e3e1041f6c tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:50.187724 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-c8037453-e474-4de3-a18e-09e3e1041f6c tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 51fd7e4e-4aea-426f-ae93-cd9dde475a9b] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:50.194930 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c8037453-e474-4de3-a18e-09e3e1041f6c tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:50.195151 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c8037453-e474-4de3-a18e-09e3e1041f6c tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:50.196252 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c8037453-e474-4de3-a18e-09e3e1041f6c tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:50.197117 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c8037453-e474-4de3-a18e-09e3e1041f6c tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:50.342389 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-c8037453-e474-4de3-a18e-09e3e1041f6c tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce9ec4aea9449d3890f6dbb93f97968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc558dd3848d4d3d950d7cd408e19741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:50.351687 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-c8037453-e474-4de3-a18e-09e3e1041f6c tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b" status: 200 len: 1503 microversion: 2.1 time: 0.168085 Jun 07 22:06:50.360415 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 339/645] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:50 2022] GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b => generated 1503 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:50.365075 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-7349ba6b-2d36-492a-8f01-da1333cf4fd1 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af02cd6ffd0484c8f6569629cd6313c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31cd38d46643fbac516d21ee4f89ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:50.366274 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-6e3dc710-d148-415c-a5de-7c769d3a4664 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:50.366274 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-6e3dc710-d148-415c-a5de-7c769d3a4664 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: f84b4686-8e5c-49af-b5ad-13f37e20f976] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:50.373461 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-6e3dc710-d148-415c-a5de-7c769d3a4664 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:50.373787 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-7349ba6b-2d36-492a-8f01-da1333cf4fd1 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b" status: 200 len: 1357 microversion: 2.1 time: 0.625412 Jun 07 22:06:50.373926 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-6e3dc710-d148-415c-a5de-7c769d3a4664 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:50.374650 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-6e3dc710-d148-415c-a5de-7c769d3a4664 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:50.375091 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-6e3dc710-d148-415c-a5de-7c769d3a4664 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:50.380086 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 307/646] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:49 2022] GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b => generated 1357 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:06:50.385475 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-d8c62cfc-f2a4-4b7c-8179-7602cb03c20e tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:50.386076 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-d8c62cfc-f2a4-4b7c-8179-7602cb03c20e tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: c2ece8dd-91fb-472c-b0c7-970ee215412f] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:50.392626 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d8c62cfc-f2a4-4b7c-8179-7602cb03c20e tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:50.393018 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d8c62cfc-f2a4-4b7c-8179-7602cb03c20e tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:50.394223 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d8c62cfc-f2a4-4b7c-8179-7602cb03c20e tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:50.394901 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d8c62cfc-f2a4-4b7c-8179-7602cb03c20e tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:50.551749 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-6e3dc710-d148-415c-a5de-7c769d3a4664 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:50.564501 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-6e3dc710-d148-415c-a5de-7c769d3a4664 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976" status: 200 len: 1370 microversion: 2.1 time: 0.202208 Jun 07 22:06:50.565500 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 340/647] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:50 2022] GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976 => generated 1370 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:50.572162 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-5ef21fe2-fbc3-4979-9e61-5c361df289cd tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:50.572854 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-5ef21fe2-fbc3-4979-9e61-5c361df289cd tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] [instance: 706597ea-671a-4be9-bfda-9ce6e1cfcf30] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:50.638794 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-5ef21fe2-fbc3-4979-9e61-5c361df289cd tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4fc7744b3d4e5fb6e281fcc90cef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b84dd581fc4e9499cfecbb7242e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:50.645945 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-5ef21fe2-fbc3-4979-9e61-5c361df289cd tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] 10.222.0.13 "GET /compute/v2.1/servers/706597ea-671a-4be9-bfda-9ce6e1cfcf30" status: 200 len: 1218 microversion: 2.1 time: 0.079312 Jun 07 22:06:50.646750 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 341/648] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:50 2022] GET /compute/v2.1/servers/706597ea-671a-4be9-bfda-9ce6e1cfcf30 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:50.665192 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-d8c62cfc-f2a4-4b7c-8179-7602cb03c20e tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:50.673268 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-d8c62cfc-f2a4-4b7c-8179-7602cb03c20e tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f" status: 200 len: 1267 microversion: 2.1 time: 0.292261 Jun 07 22:06:50.673829 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 308/649] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:50 2022] GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f => generated 1267 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:50.805037 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [req-9e4157dd-3593-4901-84c0-4ba6f7b3fa86 req-32933eb9-0c5d-4fcc-afa9-48f73a0704a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51fd7e4e-4aea-426f-ae93-cd9dde475a9b", "name": "network-vif-deleted", "tag": "fbaaf338-165c-44a5-9c49-6020632ff9bc"}]} {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:06:50.814932 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-9e4157dd-3593-4901-84c0-4ba6f7b3fa86 req-32933eb9-0c5d-4fcc-afa9-48f73a0704a2 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:50.815696 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-9e4157dd-3593-4901-84c0-4ba6f7b3fa86 req-32933eb9-0c5d-4fcc-afa9-48f73a0704a2 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:50.828117 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.compute.server_external_events [req-9e4157dd-3593-4901-84c0-4ba6f7b3fa86 req-32933eb9-0c5d-4fcc-afa9-48f73a0704a2 service nova] Creating event network-vif-deleted:fbaaf338-165c-44a5-9c49-6020632ff9bc for instance 51fd7e4e-4aea-426f-ae93-cd9dde475a9b on hv-cinder-83552 Jun 07 22:06:50.833462 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [req-9e4157dd-3593-4901-84c0-4ba6f7b3fa86 req-32933eb9-0c5d-4fcc-afa9-48f73a0704a2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032214 Jun 07 22:06:50.834968 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 342/650] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:06:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:06:51.368572 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-8a0f5e9b-080a-4e77-9154-31ecd862cbc2 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:51.369185 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-8a0f5e9b-080a-4e77-9154-31ecd862cbc2 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 51fd7e4e-4aea-426f-ae93-cd9dde475a9b] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:51.375233 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-8a0f5e9b-080a-4e77-9154-31ecd862cbc2 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:51.375737 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-8a0f5e9b-080a-4e77-9154-31ecd862cbc2 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:51.376504 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-8a0f5e9b-080a-4e77-9154-31ecd862cbc2 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:51.376934 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-8a0f5e9b-080a-4e77-9154-31ecd862cbc2 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:51.391904 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-2e95ecd7-4cb1-4fa2-97ac-d81a33ef4fb5 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:51.393278 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-2e95ecd7-4cb1-4fa2-97ac-d81a33ef4fb5 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:51.399499 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-2e95ecd7-4cb1-4fa2-97ac-d81a33ef4fb5 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:51.399953 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-2e95ecd7-4cb1-4fa2-97ac-d81a33ef4fb5 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:51.400714 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-2e95ecd7-4cb1-4fa2-97ac-d81a33ef4fb5 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:51.401158 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-2e95ecd7-4cb1-4fa2-97ac-d81a33ef4fb5 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:51.438714 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-8a0f5e9b-080a-4e77-9154-31ecd862cbc2 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce9ec4aea9449d3890f6dbb93f97968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc558dd3848d4d3d950d7cd408e19741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:51.446902 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-8a0f5e9b-080a-4e77-9154-31ecd862cbc2 tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b" status: 200 len: 1461 microversion: 2.1 time: 0.082915 Jun 07 22:06:51.447496 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 309/651] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:51 2022] GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b => generated 1461 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:51.528691 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-2e95ecd7-4cb1-4fa2-97ac-d81a33ef4fb5 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af02cd6ffd0484c8f6569629cd6313c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31cd38d46643fbac516d21ee4f89ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:51.536086 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-2e95ecd7-4cb1-4fa2-97ac-d81a33ef4fb5 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b" status: 200 len: 1357 microversion: 2.1 time: 0.148427 Jun 07 22:06:51.536641 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 343/652] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:51 2022] GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b => generated 1357 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:06:51.581866 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-3aef9914-f77f-43af-abb0-5fbd1f751a42 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:51.582476 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-3aef9914-f77f-43af-abb0-5fbd1f751a42 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: f84b4686-8e5c-49af-b5ad-13f37e20f976] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:51.588580 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-3aef9914-f77f-43af-abb0-5fbd1f751a42 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:51.589031 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-3aef9914-f77f-43af-abb0-5fbd1f751a42 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:51.589784 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-3aef9914-f77f-43af-abb0-5fbd1f751a42 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:51.590226 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-3aef9914-f77f-43af-abb0-5fbd1f751a42 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:51.663791 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-d3cbcc23-8a6f-4041-ba69-73d5094cf384 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:51.664314 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-d3cbcc23-8a6f-4041-ba69-73d5094cf384 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] [instance: 706597ea-671a-4be9-bfda-9ce6e1cfcf30] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:51.671042 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-d3cbcc23-8a6f-4041-ba69-73d5094cf384 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:51.671405 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-d3cbcc23-8a6f-4041-ba69-73d5094cf384 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:51.672186 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-d3cbcc23-8a6f-4041-ba69-73d5094cf384 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:51.672622 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-d3cbcc23-8a6f-4041-ba69-73d5094cf384 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:51.726602 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-3aef9914-f77f-43af-abb0-5fbd1f751a42 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:51.734056 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-3aef9914-f77f-43af-abb0-5fbd1f751a42 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976" status: 200 len: 1370 microversion: 2.1 time: 0.156073 Jun 07 22:06:51.734834 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 310/653] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:51 2022] GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976 => generated 1370 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:51.738512 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-d3cbcc23-8a6f-4041-ba69-73d5094cf384 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4fc7744b3d4e5fb6e281fcc90cef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b84dd581fc4e9499cfecbb7242e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:51.739000 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-fdd582d4-ee67-46ba-9429-ebb925e6d793 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:51.739621 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-fdd582d4-ee67-46ba-9429-ebb925e6d793 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: c2ece8dd-91fb-472c-b0c7-970ee215412f] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:51.746607 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-fdd582d4-ee67-46ba-9429-ebb925e6d793 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:51.747046 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-fdd582d4-ee67-46ba-9429-ebb925e6d793 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:51.747634 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-d3cbcc23-8a6f-4041-ba69-73d5094cf384 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] 10.222.0.13 "GET /compute/v2.1/servers/706597ea-671a-4be9-bfda-9ce6e1cfcf30" status: 200 len: 1214 microversion: 2.1 time: 0.088605 Jun 07 22:06:51.747825 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-fdd582d4-ee67-46ba-9429-ebb925e6d793 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:51.748201 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 344/654] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:51 2022] GET /compute/v2.1/servers/706597ea-671a-4be9-bfda-9ce6e1cfcf30 => generated 1214 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:06:51.748335 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-fdd582d4-ee67-46ba-9429-ebb925e6d793 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:51.886892 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-fdd582d4-ee67-46ba-9429-ebb925e6d793 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:51.894557 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-fdd582d4-ee67-46ba-9429-ebb925e6d793 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f" status: 200 len: 1267 microversion: 2.1 time: 0.158869 Jun 07 22:06:51.894996 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 311/655] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:51 2022] GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:52.120391 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [req-cab98ded-62b2-40c1-a544-ceecd6001621 req-a6659231-95d1-4d51-987f-4bd9292c125b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f84b4686-8e5c-49af-b5ad-13f37e20f976", "name": "network-vif-plugged", "status": "completed", "tag": "3d9f0611-4530-459f-983c-a70170e27b7f"}]} {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:06:52.128521 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-cab98ded-62b2-40c1-a544-ceecd6001621 req-a6659231-95d1-4d51-987f-4bd9292c125b service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:52.128966 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-cab98ded-62b2-40c1-a544-ceecd6001621 req-a6659231-95d1-4d51-987f-4bd9292c125b service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:52.140336 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.compute.server_external_events [req-cab98ded-62b2-40c1-a544-ceecd6001621 req-a6659231-95d1-4d51-987f-4bd9292c125b service nova] Creating event network-vif-plugged:3d9f0611-4530-459f-983c-a70170e27b7f for instance f84b4686-8e5c-49af-b5ad-13f37e20f976 on hv-cinder-83552 Jun 07 22:06:52.145036 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [req-cab98ded-62b2-40c1-a544-ceecd6001621 req-a6659231-95d1-4d51-987f-4bd9292c125b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028325 Jun 07 22:06:52.145613 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 345/656] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:06:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:06:52.464646 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-ffa95e6d-6198-4586-9410-1c5e4d2b910b tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:52.465209 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-ffa95e6d-6198-4586-9410-1c5e4d2b910b tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 51fd7e4e-4aea-426f-ae93-cd9dde475a9b] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:52.471247 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-ffa95e6d-6198-4586-9410-1c5e4d2b910b tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:52.471712 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-ffa95e6d-6198-4586-9410-1c5e4d2b910b tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:52.472453 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-ffa95e6d-6198-4586-9410-1c5e4d2b910b tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:52.472877 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-ffa95e6d-6198-4586-9410-1c5e4d2b910b tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:52.508867 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-ffa95e6d-6198-4586-9410-1c5e4d2b910b tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:52.509305 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-ffa95e6d-6198-4586-9410-1c5e4d2b910b tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:52.509742 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.objects.instance [None req-ffa95e6d-6198-4586-9410-1c5e4d2b910b tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lazy-loading 'fault' on Instance uuid 51fd7e4e-4aea-426f-ae93-cd9dde475a9b {{(pid=117970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 22:06:52.551733 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-ffa95e6d-6198-4586-9410-1c5e4d2b910b tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce9ec4aea9449d3890f6dbb93f97968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc558dd3848d4d3d950d7cd408e19741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:52.553875 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-cddf9e84-ddf4-42b0-8aa7-25bd27ae3dc3 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:52.554276 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_cell1:SELECT=100 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:06:52.554572 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-cddf9e84-ddf4-42b0-8aa7-25bd27ae3dc3 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:52.561323 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-cddf9e84-ddf4-42b0-8aa7-25bd27ae3dc3 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:52.561517 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-ffa95e6d-6198-4586-9410-1c5e4d2b910b tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b" status: 200 len: 1303 microversion: 2.1 time: 0.100970 Jun 07 22:06:52.561886 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-cddf9e84-ddf4-42b0-8aa7-25bd27ae3dc3 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:52.562080 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 312/657] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:52 2022] GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b => generated 1303 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:52.562751 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-cddf9e84-ddf4-42b0-8aa7-25bd27ae3dc3 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:52.563266 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-cddf9e84-ddf4-42b0-8aa7-25bd27ae3dc3 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:52.692640 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-cddf9e84-ddf4-42b0-8aa7-25bd27ae3dc3 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af02cd6ffd0484c8f6569629cd6313c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31cd38d46643fbac516d21ee4f89ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:52.701079 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-cddf9e84-ddf4-42b0-8aa7-25bd27ae3dc3 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b" status: 200 len: 1546 microversion: 2.1 time: 0.151417 Jun 07 22:06:52.701647 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 346/658] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:52 2022] GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b => generated 1546 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:06:52.717164 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-c290fa96-b218-4cea-bf0e-e61743f7cb69 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:52.717705 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-c290fa96-b218-4cea-bf0e-e61743f7cb69 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:52.723650 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c290fa96-b218-4cea-bf0e-e61743f7cb69 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:52.724094 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c290fa96-b218-4cea-bf0e-e61743f7cb69 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:52.724984 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c290fa96-b218-4cea-bf0e-e61743f7cb69 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:52.725413 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c290fa96-b218-4cea-bf0e-e61743f7cb69 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:52.751632 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-722bf2b8-ca78-48e2-9b20-9111272b1df3 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:52.752240 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-722bf2b8-ca78-48e2-9b20-9111272b1df3 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: f84b4686-8e5c-49af-b5ad-13f37e20f976] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:52.761186 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-722bf2b8-ca78-48e2-9b20-9111272b1df3 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:52.761949 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-722bf2b8-ca78-48e2-9b20-9111272b1df3 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:52.762387 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-722bf2b8-ca78-48e2-9b20-9111272b1df3 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:52.762824 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-722bf2b8-ca78-48e2-9b20-9111272b1df3 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:52.889218 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-c290fa96-b218-4cea-bf0e-e61743f7cb69 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af02cd6ffd0484c8f6569629cd6313c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31cd38d46643fbac516d21ee4f89ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:52.899113 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-c290fa96-b218-4cea-bf0e-e61743f7cb69 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b" status: 200 len: 1546 microversion: 2.1 time: 0.185719 Jun 07 22:06:52.899726 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 313/659] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:52 2022] GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b => generated 1546 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:52.902918 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-722bf2b8-ca78-48e2-9b20-9111272b1df3 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:52.910732 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-722bf2b8-ca78-48e2-9b20-9111272b1df3 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976" status: 200 len: 1370 microversion: 2.1 time: 0.162839 Jun 07 22:06:52.911102 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-de5a97aa-1114-4cb8-b22a-2a13783bde35 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:52.911294 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 347/660] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:52 2022] GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976 => generated 1370 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:06:52.911781 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-de5a97aa-1114-4cb8-b22a-2a13783bde35 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] [instance: 706597ea-671a-4be9-bfda-9ce6e1cfcf30] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:52.916511 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-d6aa0528-216a-49db-b6c6-2b8ee5232fc9 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:52.917121 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-d6aa0528-216a-49db-b6c6-2b8ee5232fc9 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: c2ece8dd-91fb-472c-b0c7-970ee215412f] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:52.918567 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-de5a97aa-1114-4cb8-b22a-2a13783bde35 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:52.919013 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-de5a97aa-1114-4cb8-b22a-2a13783bde35 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:52.919814 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-de5a97aa-1114-4cb8-b22a-2a13783bde35 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:52.920251 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-de5a97aa-1114-4cb8-b22a-2a13783bde35 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:52.923459 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-d6aa0528-216a-49db-b6c6-2b8ee5232fc9 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:52.923909 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-d6aa0528-216a-49db-b6c6-2b8ee5232fc9 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:52.924849 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-d6aa0528-216a-49db-b6c6-2b8ee5232fc9 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:52.925296 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-d6aa0528-216a-49db-b6c6-2b8ee5232fc9 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:52.981841 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-de5a97aa-1114-4cb8-b22a-2a13783bde35 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4fc7744b3d4e5fb6e281fcc90cef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b84dd581fc4e9499cfecbb7242e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:52.989411 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-de5a97aa-1114-4cb8-b22a-2a13783bde35 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] 10.222.0.13 "GET /compute/v2.1/servers/706597ea-671a-4be9-bfda-9ce6e1cfcf30" status: 200 len: 1278 microversion: 2.1 time: 0.082227 Jun 07 22:06:52.990611 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 314/661] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:52 2022] GET /compute/v2.1/servers/706597ea-671a-4be9-bfda-9ce6e1cfcf30 => generated 1278 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:52.995365 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-ac5fe631-3703-40ad-918f-aa5af7d8fcee tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:52.998764 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-ac5fe631-3703-40ad-918f-aa5af7d8fcee tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7af02cd6ffd0484c8f6569629cd6313c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31cd38d46643fbac516d21ee4f89ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:52.999547 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-ac5fe631-3703-40ad-918f-aa5af7d8fcee tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Searching by: {'deleted': False, 'project_id': 'bd31cd38d46643fbac516d21ee4f89ac'} {{(pid=117970) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 07 22:06:53.006599 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-ac5fe631-3703-40ad-918f-aa5af7d8fcee tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:53.007033 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-ac5fe631-3703-40ad-918f-aa5af7d8fcee tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:53.007848 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-ac5fe631-3703-40ad-918f-aa5af7d8fcee tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:53.008294 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-ac5fe631-3703-40ad-918f-aa5af7d8fcee tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:53.063546 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-d6aa0528-216a-49db-b6c6-2b8ee5232fc9 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:53.071666 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-d6aa0528-216a-49db-b6c6-2b8ee5232fc9 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f" status: 200 len: 1267 microversion: 2.1 time: 0.158643 Jun 07 22:06:53.072258 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 348/662] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:52 2022] GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:53.098620 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.multi_cell_list [None req-ac5fe631-3703-40ad-918f-aa5af7d8fcee tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117970) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 07 22:06:53.189703 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-ac5fe631-3703-40ad-918f-aa5af7d8fcee tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.197816 Jun 07 22:06:53.190278 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 315/663] 10.222.0.13 () {58 vars in 1124 bytes} [Tue Jun 7 22:06:52 2022] GET /compute/v2.1/servers => generated 342 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:06:53.201329 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-18cc6fea-d956-485d-a9f1-ec0b2f446cbb tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:53.201964 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-18cc6fea-d956-485d-a9f1-ec0b2f446cbb tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:53.210285 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-18cc6fea-d956-485d-a9f1-ec0b2f446cbb tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:53.210733 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-18cc6fea-d956-485d-a9f1-ec0b2f446cbb tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:53.211856 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-18cc6fea-d956-485d-a9f1-ec0b2f446cbb tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:53.212292 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-18cc6fea-d956-485d-a9f1-ec0b2f446cbb tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:53.231245 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_cell1:SELECT=100 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:06:53.356296 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-18cc6fea-d956-485d-a9f1-ec0b2f446cbb tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af02cd6ffd0484c8f6569629cd6313c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31cd38d46643fbac516d21ee4f89ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:53.363676 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-18cc6fea-d956-485d-a9f1-ec0b2f446cbb tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b" status: 200 len: 1546 microversion: 2.1 time: 0.166164 Jun 07 22:06:53.364243 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 349/664] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:53 2022] GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b => generated 1546 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:06:53.579908 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-4c4d5ec9-1f64-4ff2-8667-a2879b11b78a tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:53.581126 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-4c4d5ec9-1f64-4ff2-8667-a2879b11b78a tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] [instance: 51fd7e4e-4aea-426f-ae93-cd9dde475a9b] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:53.589122 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4c4d5ec9-1f64-4ff2-8667-a2879b11b78a tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:53.589575 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4c4d5ec9-1f64-4ff2-8667-a2879b11b78a tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:53.590539 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4c4d5ec9-1f64-4ff2-8667-a2879b11b78a tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:53.590923 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4c4d5ec9-1f64-4ff2-8667-a2879b11b78a tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:53.606689 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.wsgi [None req-4c4d5ec9-1f64-4ff2-8667-a2879b11b78a tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] HTTP exception thrown: Instance 51fd7e4e-4aea-426f-ae93-cd9dde475a9b could not be found. Jun 07 22:06:53.608454 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-4c4d5ec9-1f64-4ff2-8667-a2879b11b78a tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Request method failure captured: Jun 07 22:06:53.608454 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: request: GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b HTTP/1.1 Jun 07 22:06:53.608454 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Accept: application/json Jun 07 22:06:53.608454 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Accept-Encoding: identity Jun 07 22:06:53.608454 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Connection: close Jun 07 22:06:53.608454 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Content-Length: 0 Jun 07 22:06:53.608454 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Content-Type: application/json Jun 07 22:06:53.608454 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Host: 10.222.0.13 Jun 07 22:06:53.608454 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Openstack-System-Scope: None Jun 07 22:06:53.608454 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: User-Agent: python-urllib3/1.26.9 Jun 07 22:06:53.608454 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Auth-Token: gAAAAABin8uPvbBELm6ICOqMntPlHJpYbyHCWbNguIUiqhAq-raDBg7IwLstCPKcLwtp2Hs4-CMvPcMfsGXtNRChedCOrBft4n3BdMnaV7iNd7Fb0IheiDuAQhKdmDHqDY3S__c3XZFMRfg2CUrmGkcZNFdbudWIggw5HjnefouR87I42sh_9cU Jun 07 22:06:53.608454 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Domain-Id: None Jun 07 22:06:53.608454 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Domain-Name: None Jun 07 22:06:53.608454 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Identity-Status: Confirmed Jun 07 22:06:53.608454 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Is-Admin-Project: True Jun 07 22:06:53.608454 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Domain-Id: default Jun 07 22:06:53.608454 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Domain-Name: Default Jun 07 22:06:53.608454 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Id: bc558dd3848d4d3d950d7cd408e19741 Jun 07 22:06:53.608454 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Name: tempest-VolumesActionsTest-1451820778 Jun 07 22:06:53.608454 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Role: member,reader Jun 07 22:06:53.608454 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Roles: member,reader Jun 07 22:06:53.609907 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/bc558dd3848d4d3d950d7cd408e19741"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_bc558dd3848d4d3d950d7cd408e19741"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/bc558dd3848d4d3d950d7cd408e19741"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/bc558dd3848d4d3d950d7cd408e19741"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}] Jun 07 22:06:53.609907 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Tenant: tempest-VolumesActionsTest-1451820778 Jun 07 22:06:53.609907 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Tenant-Id: bc558dd3848d4d3d950d7cd408e19741 Jun 07 22:06:53.609907 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Tenant-Name: tempest-VolumesActionsTest-1451820778 Jun 07 22:06:53.609907 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User: tempest-VolumesActionsTest-1451820778-project Jun 07 22:06:53.609907 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Domain-Id: default Jun 07 22:06:53.609907 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Domain-Name: Default Jun 07 22:06:53.609907 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Id: 7ce9ec4aea9449d3890f6dbb93f97968 Jun 07 22:06:53.609907 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Name: tempest-VolumesActionsTest-1451820778-project Jun 07 22:06:53.609907 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: method: > Jun 07 22:06:53.609907 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: exception: Instance 51fd7e4e-4aea-426f-ae93-cd9dde475a9b could not be found. Jun 07 22:06:53.609907 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: action_args: {'id': '51fd7e4e-4aea-426f-ae93-cd9dde475a9b'} Jun 07 22:06:53.610674 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 22:06:53.610674 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:06:53.610674 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 22:06:53.610674 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 22:06:53.610674 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 22:06:53.610674 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 22:06:53.610674 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 22:06:53.610674 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 22:06:53.610674 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 22:06:53.610674 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 22:06:53.610674 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51fd7e4e-4aea-426f-ae93-cd9dde475a9b could not be found. Jun 07 22:06:53.610674 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:06:53.610674 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:06:53.610674 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:06:53.610674 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:06:53.610674 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:06:53.610674 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:06:53.610674 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 22:06:53.610674 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 22:06:53.610674 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 22:06:53.611947 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 22:06:53.611947 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 22:06:53.611947 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 22:06:53.611947 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 22:06:53.611947 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 22:06:53.611947 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 22:06:53.611947 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 22:06:53.611947 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51fd7e4e-4aea-426f-ae93-cd9dde475a9b could not be found. Jun 07 22:06:53.611947 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:06:53.611947 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:06:53.611947 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:06:53.611947 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:06:53.611947 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:06:53.611947 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:06:53.611947 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 22:06:53.611947 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 22:06:53.611947 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51fd7e4e-4aea-426f-ae93-cd9dde475a9b could not be found. Jun 07 22:06:53.611947 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:06:53.613470 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-4c4d5ec9-1f64-4ff2-8667-a2879b11b78a tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] Returning 404 to user: Instance 51fd7e4e-4aea-426f-ae93-cd9dde475a9b could not be found. {{(pid=117970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 22:06:53.613470 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-4c4d5ec9-1f64-4ff2-8667-a2879b11b78a tempest-VolumesActionsTest-1451820778 tempest-VolumesActionsTest-1451820778-project] 10.222.0.13 "GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b" status: 404 len: 111 microversion: 2.1 time: 0.033870 Jun 07 22:06:53.613470 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 316/665] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:53 2022] GET /compute/v2.1/servers/51fd7e4e-4aea-426f-ae93-cd9dde475a9b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 22:06:53.927759 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-285dde10-c071-4a74-8dec-f2400220c191 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:53.928634 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-285dde10-c071-4a74-8dec-f2400220c191 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: f84b4686-8e5c-49af-b5ad-13f37e20f976] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:53.935244 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-285dde10-c071-4a74-8dec-f2400220c191 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:53.935740 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-285dde10-c071-4a74-8dec-f2400220c191 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:53.936725 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-285dde10-c071-4a74-8dec-f2400220c191 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:53.937286 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-285dde10-c071-4a74-8dec-f2400220c191 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:54.007153 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-8c485fe9-2617-4bce-ba14-522781859e69 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:54.007914 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-8c485fe9-2617-4bce-ba14-522781859e69 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] [instance: 706597ea-671a-4be9-bfda-9ce6e1cfcf30] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:54.013967 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-8c485fe9-2617-4bce-ba14-522781859e69 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:54.014487 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-8c485fe9-2617-4bce-ba14-522781859e69 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:54.015510 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-8c485fe9-2617-4bce-ba14-522781859e69 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:54.016037 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-8c485fe9-2617-4bce-ba14-522781859e69 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:54.081112 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-285dde10-c071-4a74-8dec-f2400220c191 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:54.090325 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-8c485fe9-2617-4bce-ba14-522781859e69 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4fc7744b3d4e5fb6e281fcc90cef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b84dd581fc4e9499cfecbb7242e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:54.092071 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-285dde10-c071-4a74-8dec-f2400220c191 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976" status: 200 len: 1370 microversion: 2.1 time: 0.168017 Jun 07 22:06:54.092811 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 350/666] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:53 2022] GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976 => generated 1370 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:54.098294 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-14799f6e-7869-461f-85e9-19ed45b1368e tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:54.098825 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-8c485fe9-2617-4bce-ba14-522781859e69 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] 10.222.0.13 "GET /compute/v2.1/servers/706597ea-671a-4be9-bfda-9ce6e1cfcf30" status: 200 len: 1276 microversion: 2.1 time: 0.095906 Jun 07 22:06:54.099056 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-14799f6e-7869-461f-85e9-19ed45b1368e tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: c2ece8dd-91fb-472c-b0c7-970ee215412f] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:54.099866 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 317/667] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:54 2022] GET /compute/v2.1/servers/706597ea-671a-4be9-bfda-9ce6e1cfcf30 => generated 1276 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:06:54.115286 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-14799f6e-7869-461f-85e9-19ed45b1368e tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:54.115770 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-14799f6e-7869-461f-85e9-19ed45b1368e tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:54.116544 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-14799f6e-7869-461f-85e9-19ed45b1368e tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:54.116982 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-14799f6e-7869-461f-85e9-19ed45b1368e tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:54.256226 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-14799f6e-7869-461f-85e9-19ed45b1368e tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:54.264381 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-14799f6e-7869-461f-85e9-19ed45b1368e tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f" status: 200 len: 1267 microversion: 2.1 time: 0.170058 Jun 07 22:06:54.267444 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 351/668] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:54 2022] GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:55.109023 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-4193bdc4-8610-4658-8b4e-5b252ec96b6a tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:55.109662 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-4193bdc4-8610-4658-8b4e-5b252ec96b6a tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: f84b4686-8e5c-49af-b5ad-13f37e20f976] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:55.111584 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:06:55.117324 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4193bdc4-8610-4658-8b4e-5b252ec96b6a tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:55.117707 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4193bdc4-8610-4658-8b4e-5b252ec96b6a tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:55.118401 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-c64adc6c-821e-4c22-b253-a74911d0a337 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:55.118846 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4193bdc4-8610-4658-8b4e-5b252ec96b6a tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:55.118964 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4193bdc4-8610-4658-8b4e-5b252ec96b6a tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:55.119065 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-c64adc6c-821e-4c22-b253-a74911d0a337 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] [instance: 706597ea-671a-4be9-bfda-9ce6e1cfcf30] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:55.125802 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c64adc6c-821e-4c22-b253-a74911d0a337 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:55.126238 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c64adc6c-821e-4c22-b253-a74911d0a337 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:55.126987 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c64adc6c-821e-4c22-b253-a74911d0a337 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:55.127449 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c64adc6c-821e-4c22-b253-a74911d0a337 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:55.272425 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-c64adc6c-821e-4c22-b253-a74911d0a337 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4fc7744b3d4e5fb6e281fcc90cef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b84dd581fc4e9499cfecbb7242e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:55.280427 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-c64adc6c-821e-4c22-b253-a74911d0a337 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] 10.222.0.13 "GET /compute/v2.1/servers/706597ea-671a-4be9-bfda-9ce6e1cfcf30" status: 200 len: 1318 microversion: 2.1 time: 0.166329 Jun 07 22:06:55.281030 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 352/669] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:55 2022] GET /compute/v2.1/servers/706597ea-671a-4be9-bfda-9ce6e1cfcf30 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:55.287805 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-4193bdc4-8610-4658-8b4e-5b252ec96b6a tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:55.295033 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-8c51de93-af09-4984-aeae-bc45f759daa8 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:55.295397 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-4193bdc4-8610-4658-8b4e-5b252ec96b6a tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976" status: 200 len: 1370 microversion: 2.1 time: 0.190184 Jun 07 22:06:55.295676 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-8c51de93-af09-4984-aeae-bc45f759daa8 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: c2ece8dd-91fb-472c-b0c7-970ee215412f] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:55.302082 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-8c51de93-af09-4984-aeae-bc45f759daa8 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:55.302316 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-8c51de93-af09-4984-aeae-bc45f759daa8 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:55.303370 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-8c51de93-af09-4984-aeae-bc45f759daa8 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:55.303815 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-8c51de93-af09-4984-aeae-bc45f759daa8 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:55.303992 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 318/670] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:55 2022] GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976 => generated 1370 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:55.433411 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-8c51de93-af09-4984-aeae-bc45f759daa8 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:55.440982 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-8c51de93-af09-4984-aeae-bc45f759daa8 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f" status: 200 len: 1267 microversion: 2.1 time: 0.149758 Jun 07 22:06:55.441559 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 353/671] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:55 2022] GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:55.878879 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [req-2d13d430-9bad-4566-b079-921be115231c req-1ac4468a-f3e1-476e-a83d-2a5c4ca089d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "706597ea-671a-4be9-bfda-9ce6e1cfcf30", "tag": "5cecb3a0-be84-4165-b3b3-786e37122b13"}]} {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:06:55.888003 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [req-2d13d430-9bad-4566-b079-921be115231c req-1ac4468a-f3e1-476e-a83d-2a5c4ca089d8 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:55.888505 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [req-2d13d430-9bad-4566-b079-921be115231c req-1ac4468a-f3e1-476e-a83d-2a5c4ca089d8 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:55.904770 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.compute.server_external_events [req-2d13d430-9bad-4566-b079-921be115231c req-1ac4468a-f3e1-476e-a83d-2a5c4ca089d8 service nova] Creating event network-changed:5cecb3a0-be84-4165-b3b3-786e37122b13 for instance 706597ea-671a-4be9-bfda-9ce6e1cfcf30 on hv-cinder-83552 Jun 07 22:06:55.910264 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [req-2d13d430-9bad-4566-b079-921be115231c req-1ac4468a-f3e1-476e-a83d-2a5c4ca089d8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035096 Jun 07 22:06:55.910853 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 319/672] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:06:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:06:56.025228 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-f71cff50-6e8f-4033-a003-c52d137d1e95 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2ce86c91-0329-442f-a259-f9fb38918f80"}} {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:06:56.026374 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-f71cff50-6e8f-4033-a003-c52d137d1e95 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:56.032435 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-f71cff50-6e8f-4033-a003-c52d137d1e95 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:56.032884 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-f71cff50-6e8f-4033-a003-c52d137d1e95 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:56.033665 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-f71cff50-6e8f-4033-a003-c52d137d1e95 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:56.034100 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-f71cff50-6e8f-4033-a003-c52d137d1e95 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:56.298275 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-439ca8b6-225a-44ed-9863-29ee7b21d731 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:56.298967 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-439ca8b6-225a-44ed-9863-29ee7b21d731 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] [instance: 706597ea-671a-4be9-bfda-9ce6e1cfcf30] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:56.305798 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-439ca8b6-225a-44ed-9863-29ee7b21d731 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:56.306242 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-439ca8b6-225a-44ed-9863-29ee7b21d731 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:56.307212 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-439ca8b6-225a-44ed-9863-29ee7b21d731 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:56.307683 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-439ca8b6-225a-44ed-9863-29ee7b21d731 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:56.434939 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-439ca8b6-225a-44ed-9863-29ee7b21d731 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4fc7744b3d4e5fb6e281fcc90cef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b84dd581fc4e9499cfecbb7242e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:56.442313 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-439ca8b6-225a-44ed-9863-29ee7b21d731 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] 10.222.0.13 "GET /compute/v2.1/servers/706597ea-671a-4be9-bfda-9ce6e1cfcf30" status: 200 len: 1318 microversion: 2.1 time: 0.148300 Jun 07 22:06:56.442904 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 320/673] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:56 2022] GET /compute/v2.1/servers/706597ea-671a-4be9-bfda-9ce6e1cfcf30 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:06:56.447550 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-573bdea8-73b7-472c-bd86-138ae61a21e9 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:56.448161 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-573bdea8-73b7-472c-bd86-138ae61a21e9 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: f84b4686-8e5c-49af-b5ad-13f37e20f976] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:56.453662 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-573bdea8-73b7-472c-bd86-138ae61a21e9 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:56.454103 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-573bdea8-73b7-472c-bd86-138ae61a21e9 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:56.454847 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-573bdea8-73b7-472c-bd86-138ae61a21e9 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:56.455279 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-573bdea8-73b7-472c-bd86-138ae61a21e9 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:56.586337 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-573bdea8-73b7-472c-bd86-138ae61a21e9 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:56.593683 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-573bdea8-73b7-472c-bd86-138ae61a21e9 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976" status: 200 len: 1370 microversion: 2.1 time: 0.149642 Jun 07 22:06:56.594247 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 321/674] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:56 2022] GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976 => generated 1370 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:56.598497 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-45e7f09c-11bb-4aef-a068-550d36717a88 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:56.599090 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-45e7f09c-11bb-4aef-a068-550d36717a88 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: c2ece8dd-91fb-472c-b0c7-970ee215412f] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:56.605733 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-45e7f09c-11bb-4aef-a068-550d36717a88 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:56.606175 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-45e7f09c-11bb-4aef-a068-550d36717a88 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:56.606924 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-45e7f09c-11bb-4aef-a068-550d36717a88 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:56.607390 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-45e7f09c-11bb-4aef-a068-550d36717a88 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:56.735814 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-45e7f09c-11bb-4aef-a068-550d36717a88 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:56.743753 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-45e7f09c-11bb-4aef-a068-550d36717a88 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f" status: 200 len: 1267 microversion: 2.1 time: 0.148487 Jun 07 22:06:56.744265 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 322/675] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:56 2022] GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f => generated 1267 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:57.459202 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-d2b318a5-3122-42f7-b7d5-893d9883e486 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:57.459852 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-d2b318a5-3122-42f7-b7d5-893d9883e486 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] [instance: 706597ea-671a-4be9-bfda-9ce6e1cfcf30] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:57.465915 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d2b318a5-3122-42f7-b7d5-893d9883e486 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:57.466365 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d2b318a5-3122-42f7-b7d5-893d9883e486 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:57.467700 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d2b318a5-3122-42f7-b7d5-893d9883e486 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:57.468464 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d2b318a5-3122-42f7-b7d5-893d9883e486 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:57.597759 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-d2b318a5-3122-42f7-b7d5-893d9883e486 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4fc7744b3d4e5fb6e281fcc90cef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b84dd581fc4e9499cfecbb7242e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:57.605818 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-d2b318a5-3122-42f7-b7d5-893d9883e486 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] 10.222.0.13 "GET /compute/v2.1/servers/706597ea-671a-4be9-bfda-9ce6e1cfcf30" status: 200 len: 1318 microversion: 2.1 time: 0.150485 Jun 07 22:06:57.606384 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 323/676] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:57 2022] GET /compute/v2.1/servers/706597ea-671a-4be9-bfda-9ce6e1cfcf30 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:06:57.610707 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-e51f25a2-a044-4d37-b561-e4c8180b6deb tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:57.611308 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-e51f25a2-a044-4d37-b561-e4c8180b6deb tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: f84b4686-8e5c-49af-b5ad-13f37e20f976] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:57.618835 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e51f25a2-a044-4d37-b561-e4c8180b6deb tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:57.619367 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e51f25a2-a044-4d37-b561-e4c8180b6deb tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:57.620137 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e51f25a2-a044-4d37-b561-e4c8180b6deb tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:57.620594 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e51f25a2-a044-4d37-b561-e4c8180b6deb tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:57.753685 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-e51f25a2-a044-4d37-b561-e4c8180b6deb tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:57.761226 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-e51f25a2-a044-4d37-b561-e4c8180b6deb tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976" status: 200 len: 1370 microversion: 2.1 time: 0.153868 Jun 07 22:06:57.761798 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 324/677] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:57 2022] GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976 => generated 1370 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:57.766179 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-2d5cb10b-802e-419d-8429-131d17107bbb tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:57.766773 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-2d5cb10b-802e-419d-8429-131d17107bbb tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: c2ece8dd-91fb-472c-b0c7-970ee215412f] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:57.772615 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-2d5cb10b-802e-419d-8429-131d17107bbb tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:57.773065 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-2d5cb10b-802e-419d-8429-131d17107bbb tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:57.773821 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-2d5cb10b-802e-419d-8429-131d17107bbb tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:57.774259 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-2d5cb10b-802e-419d-8429-131d17107bbb tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:57.903910 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-2d5cb10b-802e-419d-8429-131d17107bbb tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:57.911173 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-2d5cb10b-802e-419d-8429-131d17107bbb tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f" status: 200 len: 1267 microversion: 2.1 time: 0.148451 Jun 07 22:06:57.912295 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 325/678] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:57 2022] GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:58.622897 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-43820e8c-8586-46e6-9fbb-b7f79cdf74b0 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:58.623601 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-43820e8c-8586-46e6-9fbb-b7f79cdf74b0 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] [instance: 706597ea-671a-4be9-bfda-9ce6e1cfcf30] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:58.629418 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-43820e8c-8586-46e6-9fbb-b7f79cdf74b0 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:58.629857 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-43820e8c-8586-46e6-9fbb-b7f79cdf74b0 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:58.631107 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-43820e8c-8586-46e6-9fbb-b7f79cdf74b0 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:58.631566 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-43820e8c-8586-46e6-9fbb-b7f79cdf74b0 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:58.784571 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-43820e8c-8586-46e6-9fbb-b7f79cdf74b0 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4fc7744b3d4e5fb6e281fcc90cef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b84dd581fc4e9499cfecbb7242e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:58.792179 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-43820e8c-8586-46e6-9fbb-b7f79cdf74b0 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] 10.222.0.13 "GET /compute/v2.1/servers/706597ea-671a-4be9-bfda-9ce6e1cfcf30" status: 200 len: 1318 microversion: 2.1 time: 0.173041 Jun 07 22:06:58.792755 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 326/679] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:58 2022] GET /compute/v2.1/servers/706597ea-671a-4be9-bfda-9ce6e1cfcf30 => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:06:58.797135 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-cd3800c9-39d4-4e0f-b461-79ed32a935cd tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:58.797838 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-cd3800c9-39d4-4e0f-b461-79ed32a935cd tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: f84b4686-8e5c-49af-b5ad-13f37e20f976] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:58.804392 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-cd3800c9-39d4-4e0f-b461-79ed32a935cd tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:58.804828 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-cd3800c9-39d4-4e0f-b461-79ed32a935cd tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:58.805577 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-cd3800c9-39d4-4e0f-b461-79ed32a935cd tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:58.806004 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-cd3800c9-39d4-4e0f-b461-79ed32a935cd tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:58.946664 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-cd3800c9-39d4-4e0f-b461-79ed32a935cd tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:58.954673 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-cd3800c9-39d4-4e0f-b461-79ed32a935cd tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976" status: 200 len: 1370 microversion: 2.1 time: 0.160952 Jun 07 22:06:58.955541 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 327/680] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:58 2022] GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976 => generated 1370 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:58.960856 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-0b68a228-5878-45de-ae35-52a8b445ba9d tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:58.961932 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-0b68a228-5878-45de-ae35-52a8b445ba9d tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: c2ece8dd-91fb-472c-b0c7-970ee215412f] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:58.968344 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0b68a228-5878-45de-ae35-52a8b445ba9d tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:58.968972 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0b68a228-5878-45de-ae35-52a8b445ba9d tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:58.969688 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0b68a228-5878-45de-ae35-52a8b445ba9d tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:58.970123 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0b68a228-5878-45de-ae35-52a8b445ba9d tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:59.119733 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-0b68a228-5878-45de-ae35-52a8b445ba9d tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:59.127843 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-0b68a228-5878-45de-ae35-52a8b445ba9d tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f" status: 200 len: 1267 microversion: 2.1 time: 0.171325 Jun 07 22:06:59.128414 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 328/681] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:58 2022] GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:06:59.808881 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-67a95c69-2068-4e3d-88e6-d69dd24a2a9b tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:59.809514 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-67a95c69-2068-4e3d-88e6-d69dd24a2a9b tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] [instance: 706597ea-671a-4be9-bfda-9ce6e1cfcf30] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:59.816131 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-67a95c69-2068-4e3d-88e6-d69dd24a2a9b tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:59.816572 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-67a95c69-2068-4e3d-88e6-d69dd24a2a9b tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:59.817314 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-67a95c69-2068-4e3d-88e6-d69dd24a2a9b tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:59.818236 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-67a95c69-2068-4e3d-88e6-d69dd24a2a9b tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:59.945970 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-67a95c69-2068-4e3d-88e6-d69dd24a2a9b tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4fc7744b3d4e5fb6e281fcc90cef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b84dd581fc4e9499cfecbb7242e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:06:59.953397 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-67a95c69-2068-4e3d-88e6-d69dd24a2a9b tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] 10.222.0.13 "GET /compute/v2.1/servers/706597ea-671a-4be9-bfda-9ce6e1cfcf30" status: 200 len: 1318 microversion: 2.1 time: 0.148293 Jun 07 22:06:59.953970 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 329/682] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:59 2022] GET /compute/v2.1/servers/706597ea-671a-4be9-bfda-9ce6e1cfcf30 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:06:59.971738 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-5212446c-e47f-49f6-b270-053c37053293 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:06:59.972338 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-5212446c-e47f-49f6-b270-053c37053293 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: f84b4686-8e5c-49af-b5ad-13f37e20f976] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:06:59.978461 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-5212446c-e47f-49f6-b270-053c37053293 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:59.978902 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-5212446c-e47f-49f6-b270-053c37053293 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:59.979714 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-5212446c-e47f-49f6-b270-053c37053293 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:06:59.980149 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-5212446c-e47f-49f6-b270-053c37053293 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:06:59.995162 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_cell1:SELECT=100 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:07:00.098257 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_cell0:SELECT=2 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:07:00.109828 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-5212446c-e47f-49f6-b270-053c37053293 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:07:00.117775 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-5212446c-e47f-49f6-b270-053c37053293 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976" status: 200 len: 1370 microversion: 2.1 time: 0.149619 Jun 07 22:07:00.118341 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 330/683] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:06:59 2022] GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976 => generated 1370 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:07:00.145593 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-f7f8fddc-b289-4027-bdf7-e7d8efc977ae tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:07:00.146223 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-f7f8fddc-b289-4027-bdf7-e7d8efc977ae tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: c2ece8dd-91fb-472c-b0c7-970ee215412f] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:07:00.152997 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f7f8fddc-b289-4027-bdf7-e7d8efc977ae tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:00.153443 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f7f8fddc-b289-4027-bdf7-e7d8efc977ae tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:00.154193 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f7f8fddc-b289-4027-bdf7-e7d8efc977ae tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:00.154635 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f7f8fddc-b289-4027-bdf7-e7d8efc977ae tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:00.286031 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-f7f8fddc-b289-4027-bdf7-e7d8efc977ae tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:07:00.294377 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-f7f8fddc-b289-4027-bdf7-e7d8efc977ae tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f" status: 200 len: 1267 microversion: 2.1 time: 0.152325 Jun 07 22:07:00.294870 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 331/684] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:07:00 2022] GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:07:00.643072 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_cell0:SELECT=8 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:07:00.970881 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-b9ee03e2-fd76-4e9d-a633-d497c5d94dd2 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:07:00.971444 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-b9ee03e2-fd76-4e9d-a633-d497c5d94dd2 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] [instance: 706597ea-671a-4be9-bfda-9ce6e1cfcf30] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:07:00.978195 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-b9ee03e2-fd76-4e9d-a633-d497c5d94dd2 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:00.978638 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-b9ee03e2-fd76-4e9d-a633-d497c5d94dd2 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:00.979416 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-b9ee03e2-fd76-4e9d-a633-d497c5d94dd2 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:00.979851 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-b9ee03e2-fd76-4e9d-a633-d497c5d94dd2 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:01.104770 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-b9ee03e2-fd76-4e9d-a633-d497c5d94dd2 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4fc7744b3d4e5fb6e281fcc90cef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b84dd581fc4e9499cfecbb7242e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:07:01.112278 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-b9ee03e2-fd76-4e9d-a633-d497c5d94dd2 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] 10.222.0.13 "GET /compute/v2.1/servers/706597ea-671a-4be9-bfda-9ce6e1cfcf30" status: 200 len: 1318 microversion: 2.1 time: 0.145275 Jun 07 22:07:01.113005 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 332/685] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:07:00 2022] GET /compute/v2.1/servers/706597ea-671a-4be9-bfda-9ce6e1cfcf30 => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:07:01.133627 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-75d9c5cf-a0fd-4a9f-9c4d-74c155f5c8e9 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:07:01.134224 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-75d9c5cf-a0fd-4a9f-9c4d-74c155f5c8e9 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: f84b4686-8e5c-49af-b5ad-13f37e20f976] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:07:01.140139 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-75d9c5cf-a0fd-4a9f-9c4d-74c155f5c8e9 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:01.140575 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-75d9c5cf-a0fd-4a9f-9c4d-74c155f5c8e9 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:01.141343 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-75d9c5cf-a0fd-4a9f-9c4d-74c155f5c8e9 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:01.141769 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-75d9c5cf-a0fd-4a9f-9c4d-74c155f5c8e9 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:01.273918 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-75d9c5cf-a0fd-4a9f-9c4d-74c155f5c8e9 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:07:01.281173 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-75d9c5cf-a0fd-4a9f-9c4d-74c155f5c8e9 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976" status: 200 len: 1370 microversion: 2.1 time: 0.151277 Jun 07 22:07:01.281731 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 333/686] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:07:01 2022] GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976 => generated 1370 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:07:01.311114 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-3fe9271d-bb0c-496f-995a-d6a04f9c71e5 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:07:01.311730 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-3fe9271d-bb0c-496f-995a-d6a04f9c71e5 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: c2ece8dd-91fb-472c-b0c7-970ee215412f] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:07:01.317251 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-3fe9271d-bb0c-496f-995a-d6a04f9c71e5 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:01.318220 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-3fe9271d-bb0c-496f-995a-d6a04f9c71e5 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:01.319448 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-3fe9271d-bb0c-496f-995a-d6a04f9c71e5 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:01.320092 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-3fe9271d-bb0c-496f-995a-d6a04f9c71e5 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:01.447772 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-3fe9271d-bb0c-496f-995a-d6a04f9c71e5 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:07:01.455059 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-3fe9271d-bb0c-496f-995a-d6a04f9c71e5 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f" status: 200 len: 1267 microversion: 2.1 time: 0.147382 Jun 07 22:07:01.455651 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 334/687] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:07:01 2022] GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f => generated 1267 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:07:02.131027 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-0b4aa3dd-34d1-4e25-a073-5318e1c6dab1 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:07:02.132013 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-0b4aa3dd-34d1-4e25-a073-5318e1c6dab1 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] [instance: 706597ea-671a-4be9-bfda-9ce6e1cfcf30] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:07:02.140683 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0b4aa3dd-34d1-4e25-a073-5318e1c6dab1 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:02.141373 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0b4aa3dd-34d1-4e25-a073-5318e1c6dab1 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:02.142641 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0b4aa3dd-34d1-4e25-a073-5318e1c6dab1 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:02.143274 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0b4aa3dd-34d1-4e25-a073-5318e1c6dab1 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:02.282626 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-0b4aa3dd-34d1-4e25-a073-5318e1c6dab1 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4fc7744b3d4e5fb6e281fcc90cef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b84dd581fc4e9499cfecbb7242e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:07:02.290973 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-0b4aa3dd-34d1-4e25-a073-5318e1c6dab1 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] 10.222.0.13 "GET /compute/v2.1/servers/706597ea-671a-4be9-bfda-9ce6e1cfcf30" status: 200 len: 1318 microversion: 2.1 time: 0.164076 Jun 07 22:07:02.291773 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 335/688] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:07:02 2022] GET /compute/v2.1/servers/706597ea-671a-4be9-bfda-9ce6e1cfcf30 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:07:02.301972 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-746d1298-31c3-4ed3-beb3-d6c9d971f896 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:07:02.303110 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-746d1298-31c3-4ed3-beb3-d6c9d971f896 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: f84b4686-8e5c-49af-b5ad-13f37e20f976] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:07:02.309244 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-746d1298-31c3-4ed3-beb3-d6c9d971f896 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:02.309722 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-746d1298-31c3-4ed3-beb3-d6c9d971f896 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:02.310485 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-746d1298-31c3-4ed3-beb3-d6c9d971f896 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:02.310948 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-746d1298-31c3-4ed3-beb3-d6c9d971f896 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:02.456078 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-746d1298-31c3-4ed3-beb3-d6c9d971f896 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:07:02.465698 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-746d1298-31c3-4ed3-beb3-d6c9d971f896 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976" status: 200 len: 1564 microversion: 2.1 time: 0.167946 Jun 07 22:07:02.468852 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 336/689] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:07:02 2022] GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976 => generated 1564 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:07:02.474710 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-4c8bd192-d1de-4326-8875-04d87b9c4528 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:07:02.475724 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-4c8bd192-d1de-4326-8875-04d87b9c4528 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: c2ece8dd-91fb-472c-b0c7-970ee215412f] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:07:02.484099 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4c8bd192-d1de-4326-8875-04d87b9c4528 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:02.485181 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4c8bd192-d1de-4326-8875-04d87b9c4528 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:02.486661 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4c8bd192-d1de-4326-8875-04d87b9c4528 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:02.487509 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4c8bd192-d1de-4326-8875-04d87b9c4528 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:02.691190 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-4c8bd192-d1de-4326-8875-04d87b9c4528 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:07:02.700686 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-4c8bd192-d1de-4326-8875-04d87b9c4528 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f" status: 200 len: 1267 microversion: 2.1 time: 0.230077 Jun 07 22:07:02.710732 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 337/690] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:07:02 2022] GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f => generated 1267 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:07:02.710732 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-c2819541-3c7d-4b7c-a683-acc5c5a668ba tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:07:02.710732 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-c2819541-3c7d-4b7c-a683-acc5c5a668ba tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: f84b4686-8e5c-49af-b5ad-13f37e20f976] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:07:02.714366 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c2819541-3c7d-4b7c-a683-acc5c5a668ba tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:02.714960 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c2819541-3c7d-4b7c-a683-acc5c5a668ba tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:02.715889 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c2819541-3c7d-4b7c-a683-acc5c5a668ba tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:02.716387 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c2819541-3c7d-4b7c-a683-acc5c5a668ba tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:02.795003 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-f71cff50-6e8f-4033-a003-c52d137d1e95 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "POST /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 6.773675 Jun 07 22:07:02.796421 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 354/691] 10.222.0.13 () {60 vars in 1322 bytes} [Tue Jun 7 22:06:56 2022] POST /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b/os-volume_attachments => generated 194 bytes in 6776 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:07:02.913574 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-c2819541-3c7d-4b7c-a683-acc5c5a668ba tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.210671 Jun 07 22:07:02.914749 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 338/692] 10.222.0.13 () {58 vars in 1274 bytes} [Tue Jun 7 22:07:02 2022] GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976/os-interface => generated 285 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:07:03.308810 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-bc77206b-4712-46e4-b744-27350fe8f157 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:07:03.309504 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-bc77206b-4712-46e4-b744-27350fe8f157 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] [instance: 706597ea-671a-4be9-bfda-9ce6e1cfcf30] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:07:03.323989 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-bc77206b-4712-46e4-b744-27350fe8f157 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:03.324714 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-bc77206b-4712-46e4-b744-27350fe8f157 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:03.325781 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-bc77206b-4712-46e4-b744-27350fe8f157 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:03.326373 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-bc77206b-4712-46e4-b744-27350fe8f157 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:03.596999 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-bc77206b-4712-46e4-b744-27350fe8f157 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4fc7744b3d4e5fb6e281fcc90cef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b84dd581fc4e9499cfecbb7242e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:07:03.609794 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-bc77206b-4712-46e4-b744-27350fe8f157 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] 10.222.0.13 "GET /compute/v2.1/servers/706597ea-671a-4be9-bfda-9ce6e1cfcf30" status: 200 len: 1318 microversion: 2.1 time: 0.305247 Jun 07 22:07:03.610366 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 355/693] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:07:03 2022] GET /compute/v2.1/servers/706597ea-671a-4be9-bfda-9ce6e1cfcf30 => generated 1318 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:07:03.715450 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_cell0:SELECT=2 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:07:03.725239 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-0bf012f6-2215-4e60-a1c1-0509aad968a8 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:07:03.727383 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-0bf012f6-2215-4e60-a1c1-0509aad968a8 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: c2ece8dd-91fb-472c-b0c7-970ee215412f] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:07:03.738954 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0bf012f6-2215-4e60-a1c1-0509aad968a8 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:03.740380 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0bf012f6-2215-4e60-a1c1-0509aad968a8 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:03.741553 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0bf012f6-2215-4e60-a1c1-0509aad968a8 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:03.742184 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0bf012f6-2215-4e60-a1c1-0509aad968a8 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:03.897752 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-0bf012f6-2215-4e60-a1c1-0509aad968a8 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:07:03.906073 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-0bf012f6-2215-4e60-a1c1-0509aad968a8 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f" status: 200 len: 1267 microversion: 2.1 time: 0.191360 Jun 07 22:07:03.923842 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 339/694] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:07:03 2022] GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f => generated 1267 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:07:04.204036 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [req-25a3817c-2c44-40dc-9e87-0dcf6e9e44ad req-32704229-642c-4c99-ac5b-95ab4f590ecb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f84b4686-8e5c-49af-b5ad-13f37e20f976", "tag": "3d9f0611-4530-459f-983c-a70170e27b7f"}]} {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:07:04.216305 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-25a3817c-2c44-40dc-9e87-0dcf6e9e44ad req-32704229-642c-4c99-ac5b-95ab4f590ecb service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:04.216305 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-25a3817c-2c44-40dc-9e87-0dcf6e9e44ad req-32704229-642c-4c99-ac5b-95ab4f590ecb service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:04.232167 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.compute.server_external_events [req-25a3817c-2c44-40dc-9e87-0dcf6e9e44ad req-32704229-642c-4c99-ac5b-95ab4f590ecb service nova] Creating event network-changed:3d9f0611-4530-459f-983c-a70170e27b7f for instance f84b4686-8e5c-49af-b5ad-13f37e20f976 on hv-cinder-83552 Jun 07 22:07:04.238125 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [req-25a3817c-2c44-40dc-9e87-0dcf6e9e44ad req-32704229-642c-4c99-ac5b-95ab4f590ecb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038526 Jun 07 22:07:04.239207 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 356/695] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:07:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:07:04.627106 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-c19315fa-b1c3-484d-bb75-1675970add44 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:07:04.628089 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-c19315fa-b1c3-484d-bb75-1675970add44 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] [instance: 706597ea-671a-4be9-bfda-9ce6e1cfcf30] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:07:04.637811 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c19315fa-b1c3-484d-bb75-1675970add44 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:04.638346 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c19315fa-b1c3-484d-bb75-1675970add44 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:04.639215 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c19315fa-b1c3-484d-bb75-1675970add44 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:04.639747 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c19315fa-b1c3-484d-bb75-1675970add44 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:04.835148 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-c19315fa-b1c3-484d-bb75-1675970add44 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4fc7744b3d4e5fb6e281fcc90cef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b84dd581fc4e9499cfecbb7242e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:07:04.844882 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-c19315fa-b1c3-484d-bb75-1675970add44 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] 10.222.0.13 "GET /compute/v2.1/servers/706597ea-671a-4be9-bfda-9ce6e1cfcf30" status: 200 len: 1318 microversion: 2.1 time: 0.221507 Jun 07 22:07:04.856878 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 340/696] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:07:04 2022] GET /compute/v2.1/servers/706597ea-671a-4be9-bfda-9ce6e1cfcf30 => generated 1318 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:07:04.923534 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-aadc2231-1619-4b17-bd7c-8e68a5d6b59b tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:07:04.924705 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-aadc2231-1619-4b17-bd7c-8e68a5d6b59b tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: c2ece8dd-91fb-472c-b0c7-970ee215412f] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:07:04.932744 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-aadc2231-1619-4b17-bd7c-8e68a5d6b59b tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:04.933567 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-aadc2231-1619-4b17-bd7c-8e68a5d6b59b tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:04.934554 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-aadc2231-1619-4b17-bd7c-8e68a5d6b59b tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:04.935197 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-aadc2231-1619-4b17-bd7c-8e68a5d6b59b tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:05.142855 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-aadc2231-1619-4b17-bd7c-8e68a5d6b59b tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:07:05.154742 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-aadc2231-1619-4b17-bd7c-8e68a5d6b59b tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f" status: 200 len: 1267 microversion: 2.1 time: 0.233321 Jun 07 22:07:05.156056 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 357/697] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:07:04 2022] GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f => generated 1267 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:07:05.867037 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-d4e7a83b-cce9-45e4-b56e-ea4fa547ebb3 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:07:05.867037 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-d4e7a83b-cce9-45e4-b56e-ea4fa547ebb3 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] [instance: 706597ea-671a-4be9-bfda-9ce6e1cfcf30] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:07:05.874765 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d4e7a83b-cce9-45e4-b56e-ea4fa547ebb3 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:05.875484 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d4e7a83b-cce9-45e4-b56e-ea4fa547ebb3 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:05.876831 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d4e7a83b-cce9-45e4-b56e-ea4fa547ebb3 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:05.877349 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d4e7a83b-cce9-45e4-b56e-ea4fa547ebb3 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:06.032227 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-d4e7a83b-cce9-45e4-b56e-ea4fa547ebb3 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4fc7744b3d4e5fb6e281fcc90cef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b84dd581fc4e9499cfecbb7242e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:07:06.041419 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-d4e7a83b-cce9-45e4-b56e-ea4fa547ebb3 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] 10.222.0.13 "GET /compute/v2.1/servers/706597ea-671a-4be9-bfda-9ce6e1cfcf30" status: 200 len: 1318 microversion: 2.1 time: 0.180543 Jun 07 22:07:06.041989 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 341/698] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:07:05 2022] GET /compute/v2.1/servers/706597ea-671a-4be9-bfda-9ce6e1cfcf30 => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:07:06.172379 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-092a81a7-6b92-410c-baf6-46e8e843a7b3 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:07:06.173206 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-092a81a7-6b92-410c-baf6-46e8e843a7b3 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: c2ece8dd-91fb-472c-b0c7-970ee215412f] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:07:06.180457 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-092a81a7-6b92-410c-baf6-46e8e843a7b3 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:06.181185 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-092a81a7-6b92-410c-baf6-46e8e843a7b3 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:06.182156 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-092a81a7-6b92-410c-baf6-46e8e843a7b3 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:06.182669 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-092a81a7-6b92-410c-baf6-46e8e843a7b3 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:06.344350 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-092a81a7-6b92-410c-baf6-46e8e843a7b3 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:07:06.355560 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-092a81a7-6b92-410c-baf6-46e8e843a7b3 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f" status: 200 len: 1267 microversion: 2.1 time: 0.186660 Jun 07 22:07:06.357076 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 358/699] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:07:06 2022] GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f => generated 1267 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:07:07.059462 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-6890ebbe-d901-4ffa-9a0e-46bb5d85d77d tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:07:07.060799 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-6890ebbe-d901-4ffa-9a0e-46bb5d85d77d tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] [instance: 706597ea-671a-4be9-bfda-9ce6e1cfcf30] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:07:07.067036 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6890ebbe-d901-4ffa-9a0e-46bb5d85d77d tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:07.068460 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6890ebbe-d901-4ffa-9a0e-46bb5d85d77d tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:07.069502 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6890ebbe-d901-4ffa-9a0e-46bb5d85d77d tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:07.070146 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6890ebbe-d901-4ffa-9a0e-46bb5d85d77d tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:07.313114 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-6890ebbe-d901-4ffa-9a0e-46bb5d85d77d tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4fc7744b3d4e5fb6e281fcc90cef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b84dd581fc4e9499cfecbb7242e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:07:07.323409 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-6890ebbe-d901-4ffa-9a0e-46bb5d85d77d tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] 10.222.0.13 "GET /compute/v2.1/servers/706597ea-671a-4be9-bfda-9ce6e1cfcf30" status: 200 len: 1318 microversion: 2.1 time: 0.267713 Jun 07 22:07:07.334645 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 342/700] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:07:07 2022] GET /compute/v2.1/servers/706597ea-671a-4be9-bfda-9ce6e1cfcf30 => generated 1318 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:07:07.373584 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-ab7aff01-e7ad-42cd-abea-1c3910622761 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:07:07.374293 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-ab7aff01-e7ad-42cd-abea-1c3910622761 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: c2ece8dd-91fb-472c-b0c7-970ee215412f] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:07:07.381504 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ab7aff01-e7ad-42cd-abea-1c3910622761 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:07.382200 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ab7aff01-e7ad-42cd-abea-1c3910622761 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:07.383152 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ab7aff01-e7ad-42cd-abea-1c3910622761 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:07.383625 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ab7aff01-e7ad-42cd-abea-1c3910622761 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:07.545946 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-ab7aff01-e7ad-42cd-abea-1c3910622761 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:07:07.555372 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-ab7aff01-e7ad-42cd-abea-1c3910622761 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f" status: 200 len: 1267 microversion: 2.1 time: 0.185621 Jun 07 22:07:07.556113 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 359/701] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:07:07 2022] GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f => generated 1267 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:07:08.347611 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-afdc0201-a482-4035-b07c-5ecef4116340 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:07:08.347611 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-afdc0201-a482-4035-b07c-5ecef4116340 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] [instance: 706597ea-671a-4be9-bfda-9ce6e1cfcf30] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:07:08.356470 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-afdc0201-a482-4035-b07c-5ecef4116340 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:08.356913 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-afdc0201-a482-4035-b07c-5ecef4116340 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:08.357683 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-afdc0201-a482-4035-b07c-5ecef4116340 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:08.358118 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-afdc0201-a482-4035-b07c-5ecef4116340 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:08.505468 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-afdc0201-a482-4035-b07c-5ecef4116340 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4fc7744b3d4e5fb6e281fcc90cef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b84dd581fc4e9499cfecbb7242e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:07:08.514286 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-afdc0201-a482-4035-b07c-5ecef4116340 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] 10.222.0.13 "GET /compute/v2.1/servers/706597ea-671a-4be9-bfda-9ce6e1cfcf30" status: 200 len: 1318 microversion: 2.1 time: 0.175567 Jun 07 22:07:08.515666 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 343/702] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:07:08 2022] GET /compute/v2.1/servers/706597ea-671a-4be9-bfda-9ce6e1cfcf30 => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:07:08.572562 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-b7bb2fca-10ff-475f-8c2a-77c53a1c9d34 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:07:08.573166 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-b7bb2fca-10ff-475f-8c2a-77c53a1c9d34 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: c2ece8dd-91fb-472c-b0c7-970ee215412f] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:07:08.579613 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b7bb2fca-10ff-475f-8c2a-77c53a1c9d34 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:08.580065 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b7bb2fca-10ff-475f-8c2a-77c53a1c9d34 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:08.580817 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b7bb2fca-10ff-475f-8c2a-77c53a1c9d34 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:08.581304 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b7bb2fca-10ff-475f-8c2a-77c53a1c9d34 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:08.910314 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-b7bb2fca-10ff-475f-8c2a-77c53a1c9d34 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:07:08.921989 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-b7bb2fca-10ff-475f-8c2a-77c53a1c9d34 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f" status: 200 len: 1267 microversion: 2.1 time: 0.353321 Jun 07 22:07:08.936557 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 360/703] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:07:08 2022] GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f => generated 1267 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:07:09.533019 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-92562db9-f618-4d2c-b912-022a0f6e5ef5 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:07:09.533772 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-92562db9-f618-4d2c-b912-022a0f6e5ef5 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] [instance: 706597ea-671a-4be9-bfda-9ce6e1cfcf30] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:07:09.541309 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-92562db9-f618-4d2c-b912-022a0f6e5ef5 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:09.542019 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-92562db9-f618-4d2c-b912-022a0f6e5ef5 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:09.542953 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-92562db9-f618-4d2c-b912-022a0f6e5ef5 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:09.544086 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-92562db9-f618-4d2c-b912-022a0f6e5ef5 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:09.678165 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-92562db9-f618-4d2c-b912-022a0f6e5ef5 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4fc7744b3d4e5fb6e281fcc90cef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b84dd581fc4e9499cfecbb7242e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:07:09.686445 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-92562db9-f618-4d2c-b912-022a0f6e5ef5 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] 10.222.0.13 "GET /compute/v2.1/servers/706597ea-671a-4be9-bfda-9ce6e1cfcf30" status: 200 len: 1318 microversion: 2.1 time: 0.157235 Jun 07 22:07:09.687025 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 344/704] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:07:09 2022] GET /compute/v2.1/servers/706597ea-671a-4be9-bfda-9ce6e1cfcf30 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:07:09.954133 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-23732859-f8cf-4fee-884a-7bc24967edc1 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:07:09.954664 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-23732859-f8cf-4fee-884a-7bc24967edc1 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: c2ece8dd-91fb-472c-b0c7-970ee215412f] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:07:09.961454 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-23732859-f8cf-4fee-884a-7bc24967edc1 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:09.961899 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-23732859-f8cf-4fee-884a-7bc24967edc1 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:09.962650 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-23732859-f8cf-4fee-884a-7bc24967edc1 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:09.963076 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-23732859-f8cf-4fee-884a-7bc24967edc1 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:10.101093 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-23732859-f8cf-4fee-884a-7bc24967edc1 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:07:10.109712 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-23732859-f8cf-4fee-884a-7bc24967edc1 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f" status: 200 len: 1267 microversion: 2.1 time: 0.159639 Jun 07 22:07:10.110738 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 361/705] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:07:09 2022] GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:07:10.624809 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [req-57c34147-b0fc-479f-a54f-7ccb0a80ac34 req-7ddaf06a-72a2-4d76-a133-54947163c299 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "706597ea-671a-4be9-bfda-9ce6e1cfcf30", "name": "network-vif-plugged", "status": "completed", "tag": "5cecb3a0-be84-4165-b3b3-786e37122b13"}]} {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:07:10.639532 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [req-57c34147-b0fc-479f-a54f-7ccb0a80ac34 req-7ddaf06a-72a2-4d76-a133-54947163c299 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:10.640028 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [req-57c34147-b0fc-479f-a54f-7ccb0a80ac34 req-7ddaf06a-72a2-4d76-a133-54947163c299 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:10.654440 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.compute.server_external_events [req-57c34147-b0fc-479f-a54f-7ccb0a80ac34 req-7ddaf06a-72a2-4d76-a133-54947163c299 service nova] Creating event network-vif-plugged:5cecb3a0-be84-4165-b3b3-786e37122b13 for instance 706597ea-671a-4be9-bfda-9ce6e1cfcf30 on hv-cinder-83552 Jun 07 22:07:10.659770 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [req-57c34147-b0fc-479f-a54f-7ccb0a80ac34 req-7ddaf06a-72a2-4d76-a133-54947163c299 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039207 Jun 07 22:07:10.661059 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 345/706] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:07:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:07:10.704195 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-88a977c5-b4ae-4658-81d8-b69a8e967f38 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:07:10.705227 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-88a977c5-b4ae-4658-81d8-b69a8e967f38 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] [instance: 706597ea-671a-4be9-bfda-9ce6e1cfcf30] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:07:10.712025 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:07:10.714618 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-88a977c5-b4ae-4658-81d8-b69a8e967f38 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:10.715371 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-88a977c5-b4ae-4658-81d8-b69a8e967f38 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:10.716426 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-88a977c5-b4ae-4658-81d8-b69a8e967f38 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:10.717200 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-88a977c5-b4ae-4658-81d8-b69a8e967f38 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:10.898697 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-88a977c5-b4ae-4658-81d8-b69a8e967f38 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4fc7744b3d4e5fb6e281fcc90cef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b84dd581fc4e9499cfecbb7242e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:07:10.907370 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-88a977c5-b4ae-4658-81d8-b69a8e967f38 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] 10.222.0.13 "GET /compute/v2.1/servers/706597ea-671a-4be9-bfda-9ce6e1cfcf30" status: 200 len: 1318 microversion: 2.1 time: 0.207134 Jun 07 22:07:10.918488 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 362/707] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:07:10 2022] GET /compute/v2.1/servers/706597ea-671a-4be9-bfda-9ce6e1cfcf30 => generated 1318 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:07:11.127872 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-755a5abf-e68e-4989-911f-1f3ce167d93f tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:07:11.128557 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-755a5abf-e68e-4989-911f-1f3ce167d93f tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: c2ece8dd-91fb-472c-b0c7-970ee215412f] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:07:11.135798 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-755a5abf-e68e-4989-911f-1f3ce167d93f tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:11.136475 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-755a5abf-e68e-4989-911f-1f3ce167d93f tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:11.137420 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-755a5abf-e68e-4989-911f-1f3ce167d93f tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:11.138022 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-755a5abf-e68e-4989-911f-1f3ce167d93f tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:11.281631 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-755a5abf-e68e-4989-911f-1f3ce167d93f tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:07:11.290302 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-755a5abf-e68e-4989-911f-1f3ce167d93f tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f" status: 200 len: 1267 microversion: 2.1 time: 0.166831 Jun 07 22:07:11.290893 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 346/708] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:07:11 2022] GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:07:11.925287 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-6fb62a4f-b520-42c4-9ee1-535a30645dc7 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:07:11.927430 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-6fb62a4f-b520-42c4-9ee1-535a30645dc7 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] [instance: 706597ea-671a-4be9-bfda-9ce6e1cfcf30] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:07:11.934860 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-6fb62a4f-b520-42c4-9ee1-535a30645dc7 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:11.935318 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-6fb62a4f-b520-42c4-9ee1-535a30645dc7 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:11.936130 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-6fb62a4f-b520-42c4-9ee1-535a30645dc7 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:11.936888 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-6fb62a4f-b520-42c4-9ee1-535a30645dc7 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:12.090707 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-6fb62a4f-b520-42c4-9ee1-535a30645dc7 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4fc7744b3d4e5fb6e281fcc90cef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b84dd581fc4e9499cfecbb7242e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:07:12.102047 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-6fb62a4f-b520-42c4-9ee1-535a30645dc7 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] 10.222.0.13 "GET /compute/v2.1/servers/706597ea-671a-4be9-bfda-9ce6e1cfcf30" status: 200 len: 1318 microversion: 2.1 time: 0.180718 Jun 07 22:07:12.102606 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 363/709] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:07:11 2022] GET /compute/v2.1/servers/706597ea-671a-4be9-bfda-9ce6e1cfcf30 => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:07:12.311062 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-e5425907-5ba7-4a94-966c-efcfe8e74d87 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:07:12.311820 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-e5425907-5ba7-4a94-966c-efcfe8e74d87 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: c2ece8dd-91fb-472c-b0c7-970ee215412f] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:07:12.320779 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e5425907-5ba7-4a94-966c-efcfe8e74d87 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:12.321488 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e5425907-5ba7-4a94-966c-efcfe8e74d87 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:12.322790 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e5425907-5ba7-4a94-966c-efcfe8e74d87 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:12.323435 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e5425907-5ba7-4a94-966c-efcfe8e74d87 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:12.483834 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-e5425907-5ba7-4a94-966c-efcfe8e74d87 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:07:12.507619 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-e5425907-5ba7-4a94-966c-efcfe8e74d87 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f" status: 200 len: 1267 microversion: 2.1 time: 0.202796 Jun 07 22:07:12.518751 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 347/710] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:07:12 2022] GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f => generated 1267 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:07:13.120842 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-0a9cfe66-c2fa-4a00-b711-afe5b589e9fa tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:07:13.121635 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-0a9cfe66-c2fa-4a00-b711-afe5b589e9fa tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] [instance: 706597ea-671a-4be9-bfda-9ce6e1cfcf30] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:07:13.129154 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-0a9cfe66-c2fa-4a00-b711-afe5b589e9fa tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:13.130666 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-0a9cfe66-c2fa-4a00-b711-afe5b589e9fa tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:13.131962 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-0a9cfe66-c2fa-4a00-b711-afe5b589e9fa tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:13.132779 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-0a9cfe66-c2fa-4a00-b711-afe5b589e9fa tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:13.328213 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-0a9cfe66-c2fa-4a00-b711-afe5b589e9fa tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4fc7744b3d4e5fb6e281fcc90cef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b84dd581fc4e9499cfecbb7242e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:07:13.337884 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-0a9cfe66-c2fa-4a00-b711-afe5b589e9fa tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] 10.222.0.13 "GET /compute/v2.1/servers/706597ea-671a-4be9-bfda-9ce6e1cfcf30" status: 200 len: 1318 microversion: 2.1 time: 0.222000 Jun 07 22:07:13.339469 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 364/711] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:07:13 2022] GET /compute/v2.1/servers/706597ea-671a-4be9-bfda-9ce6e1cfcf30 => generated 1318 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:07:13.524586 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-8c2a8824-2834-4812-9156-8218282fc7b3 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:07:13.526045 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-8c2a8824-2834-4812-9156-8218282fc7b3 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: c2ece8dd-91fb-472c-b0c7-970ee215412f] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:07:13.535782 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-8c2a8824-2834-4812-9156-8218282fc7b3 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:13.536623 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-8c2a8824-2834-4812-9156-8218282fc7b3 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:13.537750 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-8c2a8824-2834-4812-9156-8218282fc7b3 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:13.538255 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-8c2a8824-2834-4812-9156-8218282fc7b3 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:13.565432 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_cell1:SELECT=100 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:07:13.799716 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-8c2a8824-2834-4812-9156-8218282fc7b3 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:07:13.811514 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-8c2a8824-2834-4812-9156-8218282fc7b3 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f" status: 200 len: 1267 microversion: 2.1 time: 0.291243 Jun 07 22:07:13.812488 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 348/712] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:07:13 2022] GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f => generated 1267 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:07:14.356728 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-33ea63f8-6f90-4bc6-a0db-a19dcfaec8ac tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:07:14.358194 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-33ea63f8-6f90-4bc6-a0db-a19dcfaec8ac tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] [instance: 706597ea-671a-4be9-bfda-9ce6e1cfcf30] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:07:14.366415 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-33ea63f8-6f90-4bc6-a0db-a19dcfaec8ac tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:14.367316 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-33ea63f8-6f90-4bc6-a0db-a19dcfaec8ac tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:14.368496 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-33ea63f8-6f90-4bc6-a0db-a19dcfaec8ac tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:14.369041 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-33ea63f8-6f90-4bc6-a0db-a19dcfaec8ac tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:14.390382 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:07:14.522052 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-33ea63f8-6f90-4bc6-a0db-a19dcfaec8ac tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4fc7744b3d4e5fb6e281fcc90cef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b84dd581fc4e9499cfecbb7242e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:07:14.530551 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-33ea63f8-6f90-4bc6-a0db-a19dcfaec8ac tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] 10.222.0.13 "GET /compute/v2.1/servers/706597ea-671a-4be9-bfda-9ce6e1cfcf30" status: 200 len: 1508 microversion: 2.1 time: 0.178961 Jun 07 22:07:14.531864 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 365/713] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:07:14 2022] GET /compute/v2.1/servers/706597ea-671a-4be9-bfda-9ce6e1cfcf30 => generated 1508 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:07:14.548116 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-1a9e9695-e5da-4407-b6bd-78cf336f6c90 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4c3e6ad5-2413-43c8-922e-fcddddbe3f4c", "device": "/dev/sdb"}} {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:07:14.551419 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-1a9e9695-e5da-4407-b6bd-78cf336f6c90 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] [instance: 706597ea-671a-4be9-bfda-9ce6e1cfcf30] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:07:14.559780 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1a9e9695-e5da-4407-b6bd-78cf336f6c90 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:14.560640 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1a9e9695-e5da-4407-b6bd-78cf336f6c90 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:14.562049 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1a9e9695-e5da-4407-b6bd-78cf336f6c90 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:14.562697 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1a9e9695-e5da-4407-b6bd-78cf336f6c90 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:14.828917 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-2f77b058-f74a-42ba-885b-d61240d595d3 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:07:14.829845 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-2f77b058-f74a-42ba-885b-d61240d595d3 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: c2ece8dd-91fb-472c-b0c7-970ee215412f] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:07:14.838130 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-2f77b058-f74a-42ba-885b-d61240d595d3 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:14.838709 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-2f77b058-f74a-42ba-885b-d61240d595d3 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:14.839845 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-2f77b058-f74a-42ba-885b-d61240d595d3 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:14.840546 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-2f77b058-f74a-42ba-885b-d61240d595d3 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:15.104134 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-2f77b058-f74a-42ba-885b-d61240d595d3 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:07:15.120706 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-2f77b058-f74a-42ba-885b-d61240d595d3 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f" status: 200 len: 1267 microversion: 2.1 time: 0.295115 Jun 07 22:07:15.143006 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 366/714] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:07:14 2022] GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f => generated 1267 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:07:15.162718 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-1a9e9695-e5da-4407-b6bd-78cf336f6c90 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] 10.222.0.13 "POST /compute/v2.1/servers/706597ea-671a-4be9-bfda-9ce6e1cfcf30/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.618554 Jun 07 22:07:15.164013 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 349/715] 10.222.0.13 () {60 vars in 1322 bytes} [Tue Jun 7 22:07:14 2022] POST /compute/v2.1/servers/706597ea-671a-4be9-bfda-9ce6e1cfcf30/os-volume_attachments => generated 194 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:07:15.686627 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [req-77115ade-798b-4f76-abab-b383734a0a4f req-880a2690-2d04-431d-9635-eb7f2299d8ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2ece8dd-91fb-472c-b0c7-970ee215412f", "name": "network-vif-plugged", "status": "completed", "tag": "cd305cc0-e94a-48c1-a7dc-703d1a53df17"}]} {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:07:15.696689 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-77115ade-798b-4f76-abab-b383734a0a4f req-880a2690-2d04-431d-9635-eb7f2299d8ae service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:15.697474 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-77115ade-798b-4f76-abab-b383734a0a4f req-880a2690-2d04-431d-9635-eb7f2299d8ae service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:15.711368 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.compute.server_external_events [req-77115ade-798b-4f76-abab-b383734a0a4f req-880a2690-2d04-431d-9635-eb7f2299d8ae service nova] Creating event network-vif-plugged:cd305cc0-e94a-48c1-a7dc-703d1a53df17 for instance c2ece8dd-91fb-472c-b0c7-970ee215412f on hv-cinder-83552 Jun 07 22:07:15.716694 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [req-77115ade-798b-4f76-abab-b383734a0a4f req-880a2690-2d04-431d-9635-eb7f2299d8ae service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033799 Jun 07 22:07:15.717573 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 367/716] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:07:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:07:16.017820 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-43db5434-754c-46f6-bc9d-2550904371ec tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:07:16.018515 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-43db5434-754c-46f6-bc9d-2550904371ec tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:07:16.030278 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-43db5434-754c-46f6-bc9d-2550904371ec tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:16.030736 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-43db5434-754c-46f6-bc9d-2550904371ec tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:16.031546 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-43db5434-754c-46f6-bc9d-2550904371ec tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:16.031984 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-43db5434-754c-46f6-bc9d-2550904371ec tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:16.149667 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-49aed81e-bf4e-4b6d-a6f0-804bf851371d tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:07:16.150707 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-49aed81e-bf4e-4b6d-a6f0-804bf851371d tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: c2ece8dd-91fb-472c-b0c7-970ee215412f] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:07:16.158569 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-49aed81e-bf4e-4b6d-a6f0-804bf851371d tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:16.159390 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-49aed81e-bf4e-4b6d-a6f0-804bf851371d tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:16.160389 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-49aed81e-bf4e-4b6d-a6f0-804bf851371d tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:16.161679 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-49aed81e-bf4e-4b6d-a6f0-804bf851371d tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:16.217831 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-43db5434-754c-46f6-bc9d-2550904371ec tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af02cd6ffd0484c8f6569629cd6313c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31cd38d46643fbac516d21ee4f89ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:07:16.234911 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-43db5434-754c-46f6-bc9d-2550904371ec tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b" status: 200 len: 1592 microversion: 2.1 time: 0.219498 Jun 07 22:07:16.236226 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 350/717] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:07:16 2022] GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b => generated 1592 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:07:16.391199 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-49aed81e-bf4e-4b6d-a6f0-804bf851371d tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:07:16.400840 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-49aed81e-bf4e-4b6d-a6f0-804bf851371d tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f" status: 200 len: 1267 microversion: 2.1 time: 0.256356 Jun 07 22:07:16.401705 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 368/718] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:07:16 2022] GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f => generated 1267 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:07:17.419871 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-61c03c3a-19f0-4a02-98fc-d43dd0802436 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:07:17.420510 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-61c03c3a-19f0-4a02-98fc-d43dd0802436 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: c2ece8dd-91fb-472c-b0c7-970ee215412f] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:07:17.428525 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-61c03c3a-19f0-4a02-98fc-d43dd0802436 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:17.429014 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-61c03c3a-19f0-4a02-98fc-d43dd0802436 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:17.429790 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-61c03c3a-19f0-4a02-98fc-d43dd0802436 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:17.430225 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-61c03c3a-19f0-4a02-98fc-d43dd0802436 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:17.601040 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-61c03c3a-19f0-4a02-98fc-d43dd0802436 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:07:17.609998 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-61c03c3a-19f0-4a02-98fc-d43dd0802436 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f" status: 200 len: 1267 microversion: 2.1 time: 0.194671 Jun 07 22:07:17.620101 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 351/719] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:07:17 2022] GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f => generated 1267 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:07:18.627741 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-f8d194b8-2b57-4d61-9904-62580e9919d2 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:07:18.628359 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-f8d194b8-2b57-4d61-9904-62580e9919d2 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: c2ece8dd-91fb-472c-b0c7-970ee215412f] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:07:18.631106 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [req-af104419-c588-4c48-b156-c8b2be755ef5 req-705ccb16-7e51-430f-936c-6f98663bea96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbab64b0-0fb5-49d7-aeeb-d744856ddc2b", "tag": "93fff328-2cf7-4f1c-9e4e-23777eeb1a75"}]} {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:07:18.635851 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-f8d194b8-2b57-4d61-9904-62580e9919d2 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:18.636505 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-f8d194b8-2b57-4d61-9904-62580e9919d2 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:18.637448 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-f8d194b8-2b57-4d61-9904-62580e9919d2 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:18.637886 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-f8d194b8-2b57-4d61-9904-62580e9919d2 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:18.646342 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [req-af104419-c588-4c48-b156-c8b2be755ef5 req-705ccb16-7e51-430f-936c-6f98663bea96 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:18.646877 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [req-af104419-c588-4c48-b156-c8b2be755ef5 req-705ccb16-7e51-430f-936c-6f98663bea96 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:18.660797 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.compute.server_external_events [req-af104419-c588-4c48-b156-c8b2be755ef5 req-705ccb16-7e51-430f-936c-6f98663bea96 service nova] Creating event network-changed:93fff328-2cf7-4f1c-9e4e-23777eeb1a75 for instance fbab64b0-0fb5-49d7-aeeb-d744856ddc2b on hv-cinder-83552 Jun 07 22:07:18.667687 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [req-af104419-c588-4c48-b156-c8b2be755ef5 req-705ccb16-7e51-430f-936c-6f98663bea96 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042527 Jun 07 22:07:18.668550 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 352/720] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:07:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:07:18.794884 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-f8d194b8-2b57-4d61-9904-62580e9919d2 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:07:18.805457 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-f8d194b8-2b57-4d61-9904-62580e9919d2 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f" status: 200 len: 1267 microversion: 2.1 time: 0.181169 Jun 07 22:07:18.806219 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 369/721] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:07:18 2022] GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f => generated 1267 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:07:19.823531 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-1993dbcc-ba50-4056-a555-2430855450e5 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:07:19.824375 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-1993dbcc-ba50-4056-a555-2430855450e5 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: c2ece8dd-91fb-472c-b0c7-970ee215412f] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:07:19.832175 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1993dbcc-ba50-4056-a555-2430855450e5 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:19.832661 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1993dbcc-ba50-4056-a555-2430855450e5 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:19.833975 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1993dbcc-ba50-4056-a555-2430855450e5 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:19.834470 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1993dbcc-ba50-4056-a555-2430855450e5 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:19.973923 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-1993dbcc-ba50-4056-a555-2430855450e5 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:07:19.982459 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-1993dbcc-ba50-4056-a555-2430855450e5 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f" status: 200 len: 1454 microversion: 2.1 time: 0.163484 Jun 07 22:07:19.983116 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 353/722] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:07:19 2022] GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f => generated 1454 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:07:20.000939 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-3b468e66-ac36-4b81-a239-cfe46f3449a8 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:07:20.003044 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-3b468e66-ac36-4b81-a239-cfe46f3449a8 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: c2ece8dd-91fb-472c-b0c7-970ee215412f] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:07:20.010644 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-3b468e66-ac36-4b81-a239-cfe46f3449a8 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:20.011096 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-3b468e66-ac36-4b81-a239-cfe46f3449a8 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:20.012207 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-3b468e66-ac36-4b81-a239-cfe46f3449a8 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:20.012643 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-3b468e66-ac36-4b81-a239-cfe46f3449a8 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:20.207477 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-3b468e66-ac36-4b81-a239-cfe46f3449a8 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:07:20.233709 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-3b468e66-ac36-4b81-a239-cfe46f3449a8 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f" status: 200 len: 1454 microversion: 2.1 time: 0.237629 Jun 07 22:07:20.234602 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 370/723] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:07:19 2022] GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f => generated 1454 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:07:20.272852 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-6573b828-101f-4792-84ac-6c968e14e006 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-878203466"}} {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:07:20.273834 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-6573b828-101f-4792-84ac-6c968e14e006 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:07:20.281536 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6573b828-101f-4792-84ac-6c968e14e006 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:20.282276 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6573b828-101f-4792-84ac-6c968e14e006 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:20.283157 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6573b828-101f-4792-84ac-6c968e14e006 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:20.283779 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6573b828-101f-4792-84ac-6c968e14e006 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:20.570440 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.network.security_group_api [None req-6573b828-101f-4792-84ac-6c968e14e006 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Adding security group 4c3bb260-6094-458d-98a1-872c756dd1cd to port 93fff328-2cf7-4f1c-9e4e-23777eeb1a75 Jun 07 22:07:21.496262 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-6573b828-101f-4792-84ac-6c968e14e006 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "POST /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b/action" status: 202 len: 0 microversion: 2.1 time: 1.223142 Jun 07 22:07:21.499988 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [req-2d817574-8d9d-4307-8674-e38c28cb8daa req-948ad21a-64c4-4bce-b0bb-10eeaa21dc02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbab64b0-0fb5-49d7-aeeb-d744856ddc2b", "tag": "93fff328-2cf7-4f1c-9e4e-23777eeb1a75"}]} {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:07:21.503268 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 354/724] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Jun 7 22:07:20 2022] POST /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b/action => generated 0 bytes in 1235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 22:07:21.518585 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-59cbf7b0-5cb9-4235-bdbe-daea2bab6c72 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:07:21.520027 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-2d817574-8d9d-4307-8674-e38c28cb8daa req-948ad21a-64c4-4bce-b0bb-10eeaa21dc02 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:21.520309 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-59cbf7b0-5cb9-4235-bdbe-daea2bab6c72 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:07:21.537840 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-2d817574-8d9d-4307-8674-e38c28cb8daa req-948ad21a-64c4-4bce-b0bb-10eeaa21dc02 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:21.545515 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-59cbf7b0-5cb9-4235-bdbe-daea2bab6c72 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:21.546353 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-59cbf7b0-5cb9-4235-bdbe-daea2bab6c72 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:21.547499 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-59cbf7b0-5cb9-4235-bdbe-daea2bab6c72 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:21.548094 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-59cbf7b0-5cb9-4235-bdbe-daea2bab6c72 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:21.552383 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.compute.server_external_events [req-2d817574-8d9d-4307-8674-e38c28cb8daa req-948ad21a-64c4-4bce-b0bb-10eeaa21dc02 service nova] Creating event network-changed:93fff328-2cf7-4f1c-9e4e-23777eeb1a75 for instance fbab64b0-0fb5-49d7-aeeb-d744856ddc2b on hv-cinder-83552 Jun 07 22:07:21.559705 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [req-2d817574-8d9d-4307-8674-e38c28cb8daa req-948ad21a-64c4-4bce-b0bb-10eeaa21dc02 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063449 Jun 07 22:07:21.560442 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 371/725] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:07:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:07:21.797326 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-59cbf7b0-5cb9-4235-bdbe-daea2bab6c72 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af02cd6ffd0484c8f6569629cd6313c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31cd38d46643fbac516d21ee4f89ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:07:21.809032 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-59cbf7b0-5cb9-4235-bdbe-daea2bab6c72 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b" status: 200 len: 1756 microversion: 2.1 time: 0.304386 Jun 07 22:07:21.810553 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 355/726] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:07:21 2022] GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b => generated 1756 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:07:22.373148 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [req-cb632224-55e8-4cf3-9004-93a80f40bd1f req-90f17490-cf66-49b6-9420-d0f9e0a5d6fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2ece8dd-91fb-472c-b0c7-970ee215412f", "tag": "cd305cc0-e94a-48c1-a7dc-703d1a53df17"}]} {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:07:22.389732 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-cb632224-55e8-4cf3-9004-93a80f40bd1f req-90f17490-cf66-49b6-9420-d0f9e0a5d6fd service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:22.390188 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-cb632224-55e8-4cf3-9004-93a80f40bd1f req-90f17490-cf66-49b6-9420-d0f9e0a5d6fd service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:22.405400 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.compute.server_external_events [req-cb632224-55e8-4cf3-9004-93a80f40bd1f req-90f17490-cf66-49b6-9420-d0f9e0a5d6fd service nova] Creating event network-changed:cd305cc0-e94a-48c1-a7dc-703d1a53df17 for instance c2ece8dd-91fb-472c-b0c7-970ee215412f on hv-cinder-83552 Jun 07 22:07:22.413180 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [req-cb632224-55e8-4cf3-9004-93a80f40bd1f req-90f17490-cf66-49b6-9420-d0f9e0a5d6fd service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044252 Jun 07 22:07:22.415117 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 372/727] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:07:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:07:23.766051 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-a7af1234-c73e-4520-8bda-be86f7be6aea tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:07:23.767247 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-a7af1234-c73e-4520-8bda-be86f7be6aea tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 5704eeef-7ef8-4e6d-b39d-d672e9592836] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:07:23.775439 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a7af1234-c73e-4520-8bda-be86f7be6aea tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:23.776167 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a7af1234-c73e-4520-8bda-be86f7be6aea tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:23.776939 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a7af1234-c73e-4520-8bda-be86f7be6aea tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:23.777404 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a7af1234-c73e-4520-8bda-be86f7be6aea tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:23.808827 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-a7af1234-c73e-4520-8bda-be86f7be6aea tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836/ips" status: 200 len: 149 microversion: 2.1 time: 0.047084 Jun 07 22:07:23.809710 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 356/728] 10.222.0.13 () {58 vars in 1247 bytes} [Tue Jun 7 22:07:23 2022] GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836/ips => generated 149 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:07:26.286831 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-bf7907f6-ec80-4115-af55-6a4fc537ede1 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "027d8286-c9fc-451b-a66d-1737c3852496"}} {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:07:26.288128 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-bf7907f6-ec80-4115-af55-6a4fc537ede1 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 5704eeef-7ef8-4e6d-b39d-d672e9592836] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:07:26.294645 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-bf7907f6-ec80-4115-af55-6a4fc537ede1 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:26.295092 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-bf7907f6-ec80-4115-af55-6a4fc537ede1 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:26.295881 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-bf7907f6-ec80-4115-af55-6a4fc537ede1 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:26.296312 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-bf7907f6-ec80-4115-af55-6a4fc537ede1 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:30.677319 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-bf7907f6-ec80-4115-af55-6a4fc537ede1 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "POST /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.395720 Jun 07 22:07:30.678152 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 373/729] 10.222.0.13 () {60 vars in 1322 bytes} [Tue Jun 7 22:07:26 2022] POST /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836/os-volume_attachments => generated 194 bytes in 4397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:07:31.060308 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-36821862-25e0-4489-85db-9f0eb6a41045 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:07:31.060883 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-36821862-25e0-4489-85db-9f0eb6a41045 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:07:31.063360 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_api:SELECT=78 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:07:31.069460 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-36821862-25e0-4489-85db-9f0eb6a41045 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:31.069905 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-36821862-25e0-4489-85db-9f0eb6a41045 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:31.070786 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-36821862-25e0-4489-85db-9f0eb6a41045 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:31.071367 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-36821862-25e0-4489-85db-9f0eb6a41045 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:31.094921 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-36821862-25e0-4489-85db-9f0eb6a41045 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609/ips" status: 200 len: 145 microversion: 2.1 time: 0.038538 Jun 07 22:07:31.095518 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 357/730] 10.222.0.13 () {58 vars in 1247 bytes} [Tue Jun 7 22:07:31 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609/ips => generated 145 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:07:35.565926 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-93c02e8d-9338-4a9d-9282-6733441cc194 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9cbda081-f6ed-4cf9-858e-683a99628f57"}} {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:07:35.567190 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-93c02e8d-9338-4a9d-9282-6733441cc194 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:07:35.577249 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-93c02e8d-9338-4a9d-9282-6733441cc194 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:35.577701 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-93c02e8d-9338-4a9d-9282-6733441cc194 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:35.578462 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-93c02e8d-9338-4a9d-9282-6733441cc194 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:35.578898 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-93c02e8d-9338-4a9d-9282-6733441cc194 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:35.896821 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-93c02e8d-9338-4a9d-9282-6733441cc194 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "POST /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.335600 Jun 07 22:07:35.900924 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 374/731] 10.222.0.13 () {60 vars in 1322 bytes} [Tue Jun 7 22:07:35 2022] POST /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609/os-volume_attachments => generated 194 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:07:48.346416 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-60780448-d759-47ab-ab51-ab852d556a8d tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:07:48.346952 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-60780448-d759-47ab-ab51-ab852d556a8d tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] [instance: 706597ea-671a-4be9-bfda-9ce6e1cfcf30] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:07:48.349056 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_api:SELECT=1 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:07:48.349860 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:07:48.356218 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-60780448-d759-47ab-ab51-ab852d556a8d tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:48.356670 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-60780448-d759-47ab-ab51-ab852d556a8d tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:48.357434 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-60780448-d759-47ab-ab51-ab852d556a8d tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:48.357868 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-60780448-d759-47ab-ab51-ab852d556a8d tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:48.481059 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.objects.instance [None req-60780448-d759-47ab-ab51-ab852d556a8d tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lazy-loading 'services' on Instance uuid 706597ea-671a-4be9-bfda-9ce6e1cfcf30 {{(pid=117970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 22:07:48.601939 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-60780448-d759-47ab-ab51-ab852d556a8d tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] 10.222.0.13 "DELETE /compute/v2.1/servers/706597ea-671a-4be9-bfda-9ce6e1cfcf30/os-volume_attachments/4c3e6ad5-2413-43c8-922e-fcddddbe3f4c" status: 202 len: 0 microversion: 2.1 time: 0.257837 Jun 07 22:07:48.602563 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 358/732] 10.222.0.13 () {58 vars in 1415 bytes} [Tue Jun 7 22:07:48 2022] DELETE /compute/v2.1/servers/706597ea-671a-4be9-bfda-9ce6e1cfcf30/os-volume_attachments/4c3e6ad5-2413-43c8-922e-fcddddbe3f4c => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 22:07:54.022450 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-263bedb1-112b-4642-81b1-b807bb067bc8 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Action: 'create', calling method: .version_select at 0x7f92f1dd6790>, body: {"keypair": {"name": "tempest-keypair-1246217010", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBSXc0vux+pahMG5bnA8ulj5PnHhg7WX46dB+vpgyNn2kp3g8GXDt48tXezDZMjkq5Unb6GdLhu6QpVVa+L3v/Ma40vAmV4ipIfiMZE+5Y05mL7Vn9ltWOMnxNWTgdKbcw=="}} {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:07:54.027625 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_api:SELECT=25 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:07:54.028328 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:07:54.041057 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.quota [None req-263bedb1-112b-4642-81b1-b807bb067bc8 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Getting quotas for project 49d73c22e28a450a99d0952aa686dccf. Resources: {'key_pairs'} {{(pid=117971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 22:07:54.045053 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.quota [None req-263bedb1-112b-4642-81b1-b807bb067bc8 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Getting quotas for user 607b70b4d6e14c95ae2880dd3577c8ae and project 49d73c22e28a450a99d0952aa686dccf. Resources: {'key_pairs'} {{(pid=117971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 22:07:54.068998 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-263bedb1-112b-4642-81b1-b807bb067bc8 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050771 Jun 07 22:07:54.070114 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 375/733] 10.222.0.13 () {60 vars in 1158 bytes} [Tue Jun 7 22:07:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:07:55.568765 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-3e803861-f023-4bf3-9cad-d864dfbea81e tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-758648602", "imageRef": "87e2e140-6de8-4531-9681-d0a3e069622d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7dfa279a-8a9f-49b5-8669-931f3a43bf9f"}], "security_groups": [{"name": "tempest-securitygroup--1272269792"}], "key_name": "tempest-keypair-1246217010", "user_data": "}} {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:07:55.671432 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.network.neutron [None req-3e803861-f023-4bf3-9cad-d864dfbea81e tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] validate_networks() for [('7dfa279a-8a9f-49b5-8669-931f3a43bf9f', None, None, None, None, None)] {{(pid=117970) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 22:07:56.272263 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.virt.hardware [None req-3e803861-f023-4bf3-9cad-d864dfbea81e tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Flavor limits 0:0:0 {{(pid=117970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 22:07:56.272683 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.virt.hardware [None req-3e803861-f023-4bf3-9cad-d864dfbea81e tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Image limits 0:0:0 {{(pid=117970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 22:07:56.273146 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.virt.hardware [None req-3e803861-f023-4bf3-9cad-d864dfbea81e tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Flavor pref 0:0:0 {{(pid=117970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 22:07:56.273544 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.virt.hardware [None req-3e803861-f023-4bf3-9cad-d864dfbea81e tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Image pref 0:0:0 {{(pid=117970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 22:07:56.273947 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.virt.hardware [None req-3e803861-f023-4bf3-9cad-d864dfbea81e tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 22:07:56.283661 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-3e803861-f023-4bf3-9cad-d864dfbea81e tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:56.284107 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-3e803861-f023-4bf3-9cad-d864dfbea81e tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:56.284895 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-3e803861-f023-4bf3-9cad-d864dfbea81e tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:56.285328 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-3e803861-f023-4bf3-9cad-d864dfbea81e tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:56.301956 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.quota [None req-3e803861-f023-4bf3-9cad-d864dfbea81e tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Getting quotas for project 49d73c22e28a450a99d0952aa686dccf. Resources: {'cores', 'ram', 'instances'} {{(pid=117970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 22:07:56.306260 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.quota [None req-3e803861-f023-4bf3-9cad-d864dfbea81e tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Getting quotas for user 607b70b4d6e14c95ae2880dd3577c8ae and project 49d73c22e28a450a99d0952aa686dccf. Resources: {'cores', 'ram', 'instances'} {{(pid=117970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 22:07:56.317150 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-3e803861-f023-4bf3-9cad-d864dfbea81e tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Going to run 1 instances... {{(pid=117970) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 22:07:56.320000 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-3e803861-f023-4bf3-9cad-d864dfbea81e tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 53059fb5-bea1-4713-94dd-fb6cd8841fe9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='87e2e140-6de8-4531-9681-d0a3e069622d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 22:07:56.367746 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-3e803861-f023-4bf3-9cad-d864dfbea81e tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.804049 Jun 07 22:07:56.368619 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 359/734] 10.222.0.13 () {60 vars in 1146 bytes} [Tue Jun 7 22:07:55 2022] POST /compute/v2.1/servers => generated 402 bytes in 806 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 22:07:56.379060 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-6bba62c3-ce0d-4b94-9d12-8fd475de1eb9 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:07:56.379833 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-6bba62c3-ce0d-4b94-9d12-8fd475de1eb9 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 53059fb5-bea1-4713-94dd-fb6cd8841fe9] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:07:56.433873 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-6bba62c3-ce0d-4b94-9d12-8fd475de1eb9 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:07:56.441144 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-6bba62c3-ce0d-4b94-9d12-8fd475de1eb9 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/53059fb5-bea1-4713-94dd-fb6cd8841fe9" status: 200 len: 1241 microversion: 2.1 time: 0.066601 Jun 07 22:07:56.441698 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 376/735] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:07:56 2022] GET /compute/v2.1/servers/53059fb5-bea1-4713-94dd-fb6cd8841fe9 => generated 1241 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:07:57.458965 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-cd5763ae-9569-42ff-af5c-964f685bc8f8 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:07:57.459699 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-cd5763ae-9569-42ff-af5c-964f685bc8f8 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 53059fb5-bea1-4713-94dd-fb6cd8841fe9] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:07:57.466808 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-cd5763ae-9569-42ff-af5c-964f685bc8f8 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:57.467249 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-cd5763ae-9569-42ff-af5c-964f685bc8f8 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:57.468062 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-cd5763ae-9569-42ff-af5c-964f685bc8f8 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:57.468494 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-cd5763ae-9569-42ff-af5c-964f685bc8f8 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:57.557525 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-cd5763ae-9569-42ff-af5c-964f685bc8f8 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:07:57.565457 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-cd5763ae-9569-42ff-af5c-964f685bc8f8 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/53059fb5-bea1-4713-94dd-fb6cd8841fe9" status: 200 len: 1301 microversion: 2.1 time: 0.110801 Jun 07 22:07:57.576840 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 360/736] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:07:57 2022] GET /compute/v2.1/servers/53059fb5-bea1-4713-94dd-fb6cd8841fe9 => generated 1301 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:07:58.584361 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-10638b9d-fa83-423b-ac1c-d3d407a7d049 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:07:58.584970 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-10638b9d-fa83-423b-ac1c-d3d407a7d049 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 53059fb5-bea1-4713-94dd-fb6cd8841fe9] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:07:58.592583 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-10638b9d-fa83-423b-ac1c-d3d407a7d049 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:58.593037 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-10638b9d-fa83-423b-ac1c-d3d407a7d049 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:58.593806 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-10638b9d-fa83-423b-ac1c-d3d407a7d049 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:58.594243 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-10638b9d-fa83-423b-ac1c-d3d407a7d049 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:58.751063 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-10638b9d-fa83-423b-ac1c-d3d407a7d049 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:07:58.765550 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-10638b9d-fa83-423b-ac1c-d3d407a7d049 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/53059fb5-bea1-4713-94dd-fb6cd8841fe9" status: 200 len: 1367 microversion: 2.1 time: 0.184534 Jun 07 22:07:58.766329 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 377/737] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:07:58 2022] GET /compute/v2.1/servers/53059fb5-bea1-4713-94dd-fb6cd8841fe9 => generated 1367 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:07:59.080860 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [req-7cb6d2b4-b606-4ee3-96f0-e165ec716e4d req-3bf6f227-921b-4d44-8e7b-1cbd996db3d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53059fb5-bea1-4713-94dd-fb6cd8841fe9", "tag": "0b12561e-8139-44a2-93a1-3af2cfa0666e"}]} {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:07:59.111812 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [req-7cb6d2b4-b606-4ee3-96f0-e165ec716e4d req-3bf6f227-921b-4d44-8e7b-1cbd996db3d9 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:59.112307 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [req-7cb6d2b4-b606-4ee3-96f0-e165ec716e4d req-3bf6f227-921b-4d44-8e7b-1cbd996db3d9 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:59.137929 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.compute.server_external_events [req-7cb6d2b4-b606-4ee3-96f0-e165ec716e4d req-3bf6f227-921b-4d44-8e7b-1cbd996db3d9 service nova] Creating event network-changed:0b12561e-8139-44a2-93a1-3af2cfa0666e for instance 53059fb5-bea1-4713-94dd-fb6cd8841fe9 on hv-cinder-83552 Jun 07 22:07:59.155661 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [req-7cb6d2b4-b606-4ee3-96f0-e165ec716e4d req-3bf6f227-921b-4d44-8e7b-1cbd996db3d9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078898 Jun 07 22:07:59.156589 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 361/738] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:07:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:07:59.783574 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-775d98a9-dc70-42f3-8a52-6c92e1238909 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:07:59.784184 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-775d98a9-dc70-42f3-8a52-6c92e1238909 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 53059fb5-bea1-4713-94dd-fb6cd8841fe9] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:07:59.791312 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-775d98a9-dc70-42f3-8a52-6c92e1238909 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:59.791785 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-775d98a9-dc70-42f3-8a52-6c92e1238909 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:59.792537 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-775d98a9-dc70-42f3-8a52-6c92e1238909 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:07:59.793007 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-775d98a9-dc70-42f3-8a52-6c92e1238909 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:07:59.933018 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-775d98a9-dc70-42f3-8a52-6c92e1238909 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:07:59.940398 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-775d98a9-dc70-42f3-8a52-6c92e1238909 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/53059fb5-bea1-4713-94dd-fb6cd8841fe9" status: 200 len: 1367 microversion: 2.1 time: 0.160823 Jun 07 22:07:59.940962 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 378/739] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:07:59 2022] GET /compute/v2.1/servers/53059fb5-bea1-4713-94dd-fb6cd8841fe9 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:08:00.958527 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-ec03b9bd-0126-4c3d-a0c2-f52404f0f457 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:08:00.959212 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-ec03b9bd-0126-4c3d-a0c2-f52404f0f457 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 53059fb5-bea1-4713-94dd-fb6cd8841fe9] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:08:00.965477 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-ec03b9bd-0126-4c3d-a0c2-f52404f0f457 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:00.965921 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-ec03b9bd-0126-4c3d-a0c2-f52404f0f457 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:00.966677 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-ec03b9bd-0126-4c3d-a0c2-f52404f0f457 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:00.967107 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-ec03b9bd-0126-4c3d-a0c2-f52404f0f457 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:01.093523 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-ec03b9bd-0126-4c3d-a0c2-f52404f0f457 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:01.100947 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-ec03b9bd-0126-4c3d-a0c2-f52404f0f457 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/53059fb5-bea1-4713-94dd-fb6cd8841fe9" status: 200 len: 1367 microversion: 2.1 time: 0.147104 Jun 07 22:08:01.101764 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 362/740] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:08:00 2022] GET /compute/v2.1/servers/53059fb5-bea1-4713-94dd-fb6cd8841fe9 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:08:02.117754 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-1de58984-7a34-44e4-af5c-c029eef28aec tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:08:02.118363 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-1de58984-7a34-44e4-af5c-c029eef28aec tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 53059fb5-bea1-4713-94dd-fb6cd8841fe9] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:08:02.124772 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-1de58984-7a34-44e4-af5c-c029eef28aec tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:02.125216 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-1de58984-7a34-44e4-af5c-c029eef28aec tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:02.125991 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-1de58984-7a34-44e4-af5c-c029eef28aec tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:02.126419 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-1de58984-7a34-44e4-af5c-c029eef28aec tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:02.254283 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-1de58984-7a34-44e4-af5c-c029eef28aec tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:02.262515 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-1de58984-7a34-44e4-af5c-c029eef28aec tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/53059fb5-bea1-4713-94dd-fb6cd8841fe9" status: 200 len: 1367 microversion: 2.1 time: 0.149059 Jun 07 22:08:02.263081 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 379/741] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:08:02 2022] GET /compute/v2.1/servers/53059fb5-bea1-4713-94dd-fb6cd8841fe9 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:08:03.281350 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-82ddecc1-cfbc-473b-9c46-d05bf3d77e81 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:08:03.281958 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-82ddecc1-cfbc-473b-9c46-d05bf3d77e81 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 53059fb5-bea1-4713-94dd-fb6cd8841fe9] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:08:03.288145 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-82ddecc1-cfbc-473b-9c46-d05bf3d77e81 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:03.289285 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-82ddecc1-cfbc-473b-9c46-d05bf3d77e81 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:03.290053 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-82ddecc1-cfbc-473b-9c46-d05bf3d77e81 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:03.290485 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-82ddecc1-cfbc-473b-9c46-d05bf3d77e81 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:03.423297 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-82ddecc1-cfbc-473b-9c46-d05bf3d77e81 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:03.431606 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-82ddecc1-cfbc-473b-9c46-d05bf3d77e81 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/53059fb5-bea1-4713-94dd-fb6cd8841fe9" status: 200 len: 1367 microversion: 2.1 time: 0.154133 Jun 07 22:08:03.432477 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 363/742] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:08:03 2022] GET /compute/v2.1/servers/53059fb5-bea1-4713-94dd-fb6cd8841fe9 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:08:04.449000 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-e7f062c5-79ca-4b61-880f-b09e74f09f8d tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:08:04.449608 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-e7f062c5-79ca-4b61-880f-b09e74f09f8d tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 53059fb5-bea1-4713-94dd-fb6cd8841fe9] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:08:04.456205 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e7f062c5-79ca-4b61-880f-b09e74f09f8d tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:04.456647 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e7f062c5-79ca-4b61-880f-b09e74f09f8d tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:04.457392 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e7f062c5-79ca-4b61-880f-b09e74f09f8d tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:04.457821 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e7f062c5-79ca-4b61-880f-b09e74f09f8d tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:04.773054 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-e7f062c5-79ca-4b61-880f-b09e74f09f8d tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:04.780647 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-e7f062c5-79ca-4b61-880f-b09e74f09f8d tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/53059fb5-bea1-4713-94dd-fb6cd8841fe9" status: 200 len: 1367 microversion: 2.1 time: 0.336228 Jun 07 22:08:04.781199 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 380/743] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:08:04 2022] GET /compute/v2.1/servers/53059fb5-bea1-4713-94dd-fb6cd8841fe9 => generated 1367 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:08:05.557299 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-6b0f73e4-30ce-472f-98aa-2a5900496bc6 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:08:05.564120 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6b0f73e4-30ce-472f-98aa-2a5900496bc6 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:05.564654 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6b0f73e4-30ce-472f-98aa-2a5900496bc6 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:05.626601 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-6b0f73e4-30ce-472f-98aa-2a5900496bc6 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Going to try to stop instance {{(pid=117970) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 07 22:08:05.668312 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-6b0f73e4-30ce-472f-98aa-2a5900496bc6 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "POST /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609/action" status: 202 len: 0 microversion: 2.1 time: 0.115027 Jun 07 22:08:05.668905 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 364/744] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Jun 7 22:08:05 2022] POST /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 22:08:05.676769 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-d1a86d3f-79b9-4844-ae40-e4445489e380 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:08:05.677386 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-d1a86d3f-79b9-4844-ae40-e4445489e380 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:08:05.684511 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-d1a86d3f-79b9-4844-ae40-e4445489e380 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:05.684960 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-d1a86d3f-79b9-4844-ae40-e4445489e380 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:05.685730 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-d1a86d3f-79b9-4844-ae40-e4445489e380 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:05.686169 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-d1a86d3f-79b9-4844-ae40-e4445489e380 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:05.798421 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-e33320ef-1a49-4201-941c-c214b1e72b04 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:08:05.799109 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-e33320ef-1a49-4201-941c-c214b1e72b04 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 53059fb5-bea1-4713-94dd-fb6cd8841fe9] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:08:05.805434 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e33320ef-1a49-4201-941c-c214b1e72b04 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:05.805880 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e33320ef-1a49-4201-941c-c214b1e72b04 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:05.806630 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e33320ef-1a49-4201-941c-c214b1e72b04 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:05.807269 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e33320ef-1a49-4201-941c-c214b1e72b04 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:05.821545 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-d1a86d3f-79b9-4844-ae40-e4445489e380 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:05.829488 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-d1a86d3f-79b9-4844-ae40-e4445489e380 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1720 microversion: 2.1 time: 0.156508 Jun 07 22:08:05.830060 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 381/745] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:08:05 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:08:05.990814 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-e33320ef-1a49-4201-941c-c214b1e72b04 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:06.000366 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-e33320ef-1a49-4201-941c-c214b1e72b04 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/53059fb5-bea1-4713-94dd-fb6cd8841fe9" status: 200 len: 1367 microversion: 2.1 time: 0.206086 Jun 07 22:08:06.000925 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 365/746] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:08:05 2022] GET /compute/v2.1/servers/53059fb5-bea1-4713-94dd-fb6cd8841fe9 => generated 1367 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:08:06.847207 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-0b6a3868-d52c-4694-b037-a612687c462f tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:08:06.847852 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-0b6a3868-d52c-4694-b037-a612687c462f tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:08:06.849765 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_cell0:SELECT=6 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:08:06.855825 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-0b6a3868-d52c-4694-b037-a612687c462f tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:06.856271 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-0b6a3868-d52c-4694-b037-a612687c462f tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:06.857022 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-0b6a3868-d52c-4694-b037-a612687c462f tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:06.857446 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-0b6a3868-d52c-4694-b037-a612687c462f tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:06.983464 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-0b6a3868-d52c-4694-b037-a612687c462f tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:06.991185 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-0b6a3868-d52c-4694-b037-a612687c462f tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1720 microversion: 2.1 time: 0.147787 Jun 07 22:08:06.992482 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 382/747] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:08:06 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1720 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:08:07.016953 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-2be4e572-b8a3-422e-a25a-621e0f8d0152 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:08:07.017558 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-2be4e572-b8a3-422e-a25a-621e0f8d0152 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 53059fb5-bea1-4713-94dd-fb6cd8841fe9] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:08:07.019516 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_cell0:SELECT=2 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:08:07.020435 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_cell0:SELECT=6 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:08:07.027185 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-2be4e572-b8a3-422e-a25a-621e0f8d0152 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:07.027683 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-2be4e572-b8a3-422e-a25a-621e0f8d0152 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:07.028532 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-2be4e572-b8a3-422e-a25a-621e0f8d0152 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:07.028981 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-2be4e572-b8a3-422e-a25a-621e0f8d0152 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:07.157714 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-2be4e572-b8a3-422e-a25a-621e0f8d0152 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:07.165410 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-2be4e572-b8a3-422e-a25a-621e0f8d0152 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/53059fb5-bea1-4713-94dd-fb6cd8841fe9" status: 200 len: 1367 microversion: 2.1 time: 0.152254 Jun 07 22:08:07.165967 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 366/748] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:08:07 2022] GET /compute/v2.1/servers/53059fb5-bea1-4713-94dd-fb6cd8841fe9 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:08:08.009645 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-8cf16cd9-fd81-4a6b-8618-45ec13604ee5 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:08:08.010321 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-8cf16cd9-fd81-4a6b-8618-45ec13604ee5 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:08:08.016739 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-8cf16cd9-fd81-4a6b-8618-45ec13604ee5 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:08.017192 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-8cf16cd9-fd81-4a6b-8618-45ec13604ee5 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:08.017955 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-8cf16cd9-fd81-4a6b-8618-45ec13604ee5 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:08.018395 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-8cf16cd9-fd81-4a6b-8618-45ec13604ee5 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:08.150980 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-8cf16cd9-fd81-4a6b-8618-45ec13604ee5 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:08.158879 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-8cf16cd9-fd81-4a6b-8618-45ec13604ee5 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1720 microversion: 2.1 time: 0.153660 Jun 07 22:08:08.159464 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 383/749] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:08:08 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:08:08.181961 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-56839ef1-6b3d-4021-818b-3c7b013dd4bb tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:08:08.182573 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-56839ef1-6b3d-4021-818b-3c7b013dd4bb tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 53059fb5-bea1-4713-94dd-fb6cd8841fe9] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:08:08.188998 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-56839ef1-6b3d-4021-818b-3c7b013dd4bb tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:08.189436 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-56839ef1-6b3d-4021-818b-3c7b013dd4bb tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:08.190179 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-56839ef1-6b3d-4021-818b-3c7b013dd4bb tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:08.190605 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-56839ef1-6b3d-4021-818b-3c7b013dd4bb tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:08.319625 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-56839ef1-6b3d-4021-818b-3c7b013dd4bb tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:08.326943 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-56839ef1-6b3d-4021-818b-3c7b013dd4bb tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/53059fb5-bea1-4713-94dd-fb6cd8841fe9" status: 200 len: 1367 microversion: 2.1 time: 0.149033 Jun 07 22:08:08.327528 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 367/750] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:08:08 2022] GET /compute/v2.1/servers/53059fb5-bea1-4713-94dd-fb6cd8841fe9 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:08:09.175850 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-fe13da41-0dbd-4e30-b732-75c34f1bbb5b tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:08:09.176392 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-fe13da41-0dbd-4e30-b732-75c34f1bbb5b tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:08:09.183845 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-fe13da41-0dbd-4e30-b732-75c34f1bbb5b tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:09.184281 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-fe13da41-0dbd-4e30-b732-75c34f1bbb5b tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:09.185030 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-fe13da41-0dbd-4e30-b732-75c34f1bbb5b tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:09.185469 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-fe13da41-0dbd-4e30-b732-75c34f1bbb5b tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:09.310542 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-fe13da41-0dbd-4e30-b732-75c34f1bbb5b tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:09.318548 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-fe13da41-0dbd-4e30-b732-75c34f1bbb5b tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1720 microversion: 2.1 time: 0.146579 Jun 07 22:08:09.319155 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 384/751] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:08:09 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1720 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:08:09.344071 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-08e94618-a076-413f-bd31-7016e2fc346a tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:08:09.344682 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-08e94618-a076-413f-bd31-7016e2fc346a tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 53059fb5-bea1-4713-94dd-fb6cd8841fe9] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:08:09.359855 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-08e94618-a076-413f-bd31-7016e2fc346a tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:09.360351 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-08e94618-a076-413f-bd31-7016e2fc346a tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:09.361103 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-08e94618-a076-413f-bd31-7016e2fc346a tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:09.361544 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-08e94618-a076-413f-bd31-7016e2fc346a tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:09.495256 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-08e94618-a076-413f-bd31-7016e2fc346a tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:09.502570 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-08e94618-a076-413f-bd31-7016e2fc346a tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/53059fb5-bea1-4713-94dd-fb6cd8841fe9" status: 200 len: 1367 microversion: 2.1 time: 0.162370 Jun 07 22:08:09.503136 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 368/752] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:08:09 2022] GET /compute/v2.1/servers/53059fb5-bea1-4713-94dd-fb6cd8841fe9 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:08:10.349126 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-90cb84b8-7aa1-4522-b8fb-5d2edfc10511 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:08:10.349731 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-90cb84b8-7aa1-4522-b8fb-5d2edfc10511 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:08:10.357178 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-90cb84b8-7aa1-4522-b8fb-5d2edfc10511 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:10.357628 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-90cb84b8-7aa1-4522-b8fb-5d2edfc10511 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:10.358386 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-90cb84b8-7aa1-4522-b8fb-5d2edfc10511 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:10.358826 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-90cb84b8-7aa1-4522-b8fb-5d2edfc10511 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:10.492585 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-90cb84b8-7aa1-4522-b8fb-5d2edfc10511 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:10.500678 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-90cb84b8-7aa1-4522-b8fb-5d2edfc10511 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1720 microversion: 2.1 time: 0.155461 Jun 07 22:08:10.501242 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 385/753] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:08:10 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:08:10.519085 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-54cc5ee7-bcdf-4fe0-a878-4a46eabcf60d tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:08:10.519721 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-54cc5ee7-bcdf-4fe0-a878-4a46eabcf60d tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 53059fb5-bea1-4713-94dd-fb6cd8841fe9] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:08:10.526208 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-54cc5ee7-bcdf-4fe0-a878-4a46eabcf60d tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:10.526648 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-54cc5ee7-bcdf-4fe0-a878-4a46eabcf60d tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:10.527435 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-54cc5ee7-bcdf-4fe0-a878-4a46eabcf60d tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:10.527867 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-54cc5ee7-bcdf-4fe0-a878-4a46eabcf60d tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:10.727690 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-54cc5ee7-bcdf-4fe0-a878-4a46eabcf60d tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:10.735051 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-54cc5ee7-bcdf-4fe0-a878-4a46eabcf60d tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/53059fb5-bea1-4713-94dd-fb6cd8841fe9" status: 200 len: 1367 microversion: 2.1 time: 0.219758 Jun 07 22:08:10.735667 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 369/754] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:08:10 2022] GET /compute/v2.1/servers/53059fb5-bea1-4713-94dd-fb6cd8841fe9 => generated 1367 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:08:11.518073 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-4436f175-7380-463f-bff8-8816a46a92f3 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:08:11.518657 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-4436f175-7380-463f-bff8-8816a46a92f3 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:08:11.525586 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-4436f175-7380-463f-bff8-8816a46a92f3 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:11.526192 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-4436f175-7380-463f-bff8-8816a46a92f3 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:11.526954 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-4436f175-7380-463f-bff8-8816a46a92f3 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:11.527425 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-4436f175-7380-463f-bff8-8816a46a92f3 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:11.656068 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-4436f175-7380-463f-bff8-8816a46a92f3 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:11.664119 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-4436f175-7380-463f-bff8-8816a46a92f3 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1720 microversion: 2.1 time: 0.150036 Jun 07 22:08:11.664662 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 386/755] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:08:11 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1720 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:08:11.752069 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-9c2ce338-ad42-4d06-b407-4ffd8fea8a58 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:08:11.752692 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-9c2ce338-ad42-4d06-b407-4ffd8fea8a58 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 53059fb5-bea1-4713-94dd-fb6cd8841fe9] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:08:11.759152 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-9c2ce338-ad42-4d06-b407-4ffd8fea8a58 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:11.759627 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-9c2ce338-ad42-4d06-b407-4ffd8fea8a58 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:11.760378 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-9c2ce338-ad42-4d06-b407-4ffd8fea8a58 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:11.760805 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-9c2ce338-ad42-4d06-b407-4ffd8fea8a58 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:11.891217 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-9c2ce338-ad42-4d06-b407-4ffd8fea8a58 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:11.898911 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-9c2ce338-ad42-4d06-b407-4ffd8fea8a58 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/53059fb5-bea1-4713-94dd-fb6cd8841fe9" status: 200 len: 1367 microversion: 2.1 time: 0.150571 Jun 07 22:08:11.899528 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 370/756] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:08:11 2022] GET /compute/v2.1/servers/53059fb5-bea1-4713-94dd-fb6cd8841fe9 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:08:12.387950 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [req-e66df4bf-6fb2-499c-bf2e-6a962eca9e00 req-8fafbed0-2fd2-4057-bf2f-f1c65cdfb620 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53059fb5-bea1-4713-94dd-fb6cd8841fe9", "name": "network-vif-plugged", "status": "completed", "tag": "0b12561e-8139-44a2-93a1-3af2cfa0666e"}]} {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:08:12.406321 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-e66df4bf-6fb2-499c-bf2e-6a962eca9e00 req-8fafbed0-2fd2-4057-bf2f-f1c65cdfb620 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:12.406764 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-e66df4bf-6fb2-499c-bf2e-6a962eca9e00 req-8fafbed0-2fd2-4057-bf2f-f1c65cdfb620 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:12.421475 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.compute.server_external_events [req-e66df4bf-6fb2-499c-bf2e-6a962eca9e00 req-8fafbed0-2fd2-4057-bf2f-f1c65cdfb620 service nova] Creating event network-vif-plugged:0b12561e-8139-44a2-93a1-3af2cfa0666e for instance 53059fb5-bea1-4713-94dd-fb6cd8841fe9 on hv-cinder-83552 Jun 07 22:08:12.428388 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [req-e66df4bf-6fb2-499c-bf2e-6a962eca9e00 req-8fafbed0-2fd2-4057-bf2f-f1c65cdfb620 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044051 Jun 07 22:08:12.429743 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 387/757] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:08:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 22:08:12.681828 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-500bd9ec-9053-4367-83e2-1802b45025f5 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:08:12.682449 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-500bd9ec-9053-4367-83e2-1802b45025f5 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:08:12.688450 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-500bd9ec-9053-4367-83e2-1802b45025f5 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:12.688901 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-500bd9ec-9053-4367-83e2-1802b45025f5 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:12.689673 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-500bd9ec-9053-4367-83e2-1802b45025f5 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:12.690115 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-500bd9ec-9053-4367-83e2-1802b45025f5 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:12.895469 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-500bd9ec-9053-4367-83e2-1802b45025f5 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:12.904115 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-500bd9ec-9053-4367-83e2-1802b45025f5 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1720 microversion: 2.1 time: 0.226739 Jun 07 22:08:12.904679 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 371/758] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:08:12 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1720 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:08:12.917217 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-4b6bfa80-6a0a-497f-a6f7-9f8b19cce933 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:08:12.917913 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-4b6bfa80-6a0a-497f-a6f7-9f8b19cce933 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 53059fb5-bea1-4713-94dd-fb6cd8841fe9] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:08:12.924154 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-4b6bfa80-6a0a-497f-a6f7-9f8b19cce933 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:12.924543 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-4b6bfa80-6a0a-497f-a6f7-9f8b19cce933 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:12.925379 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-4b6bfa80-6a0a-497f-a6f7-9f8b19cce933 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:12.925816 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-4b6bfa80-6a0a-497f-a6f7-9f8b19cce933 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:12.977645 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-c0d197cb-4683-4f81-a166-90f6f9f4daa5 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:08:12.978141 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-c0d197cb-4683-4f81-a166-90f6f9f4daa5 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] [instance: 706597ea-671a-4be9-bfda-9ce6e1cfcf30] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:08:12.984183 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c0d197cb-4683-4f81-a166-90f6f9f4daa5 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:12.984636 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c0d197cb-4683-4f81-a166-90f6f9f4daa5 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:12.985394 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c0d197cb-4683-4f81-a166-90f6f9f4daa5 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:12.985830 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c0d197cb-4683-4f81-a166-90f6f9f4daa5 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:13.016043 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-c0d197cb-4683-4f81-a166-90f6f9f4daa5 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] [instance: 706597ea-671a-4be9-bfda-9ce6e1cfcf30] Going to try to terminate instance {{(pid=117970) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 22:08:13.059207 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-4b6bfa80-6a0a-497f-a6f7-9f8b19cce933 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:13.063171 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:08:13.066883 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-4b6bfa80-6a0a-497f-a6f7-9f8b19cce933 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/53059fb5-bea1-4713-94dd-fb6cd8841fe9" status: 200 len: 1367 microversion: 2.1 time: 0.154905 Jun 07 22:08:13.067544 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 388/759] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:08:12 2022] GET /compute/v2.1/servers/53059fb5-bea1-4713-94dd-fb6cd8841fe9 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:08:13.098984 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-c0d197cb-4683-4f81-a166-90f6f9f4daa5 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] 10.222.0.13 "DELETE /compute/v2.1/servers/706597ea-671a-4be9-bfda-9ce6e1cfcf30" status: 204 len: 0 microversion: 2.1 time: 0.125551 Jun 07 22:08:13.099593 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 372/760] 10.222.0.13 () {58 vars in 1238 bytes} [Tue Jun 7 22:08:12 2022] DELETE /compute/v2.1/servers/706597ea-671a-4be9-bfda-9ce6e1cfcf30 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 07 22:08:13.108494 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-014a045a-6875-495b-8f9f-c5c795c3be4b tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:08:13.109107 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-014a045a-6875-495b-8f9f-c5c795c3be4b tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] [instance: 706597ea-671a-4be9-bfda-9ce6e1cfcf30] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:08:13.115030 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-014a045a-6875-495b-8f9f-c5c795c3be4b tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:13.115523 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-014a045a-6875-495b-8f9f-c5c795c3be4b tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:13.116447 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-014a045a-6875-495b-8f9f-c5c795c3be4b tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:13.117075 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-014a045a-6875-495b-8f9f-c5c795c3be4b tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:13.245479 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-014a045a-6875-495b-8f9f-c5c795c3be4b tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4fc7744b3d4e5fb6e281fcc90cef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b84dd581fc4e9499cfecbb7242e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:13.252796 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-014a045a-6875-495b-8f9f-c5c795c3be4b tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] 10.222.0.13 "GET /compute/v2.1/servers/706597ea-671a-4be9-bfda-9ce6e1cfcf30" status: 200 len: 1514 microversion: 2.1 time: 0.148072 Jun 07 22:08:13.253348 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 389/761] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:08:13 2022] GET /compute/v2.1/servers/706597ea-671a-4be9-bfda-9ce6e1cfcf30 => generated 1514 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:08:13.922481 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-405131ea-5620-42ad-a1b3-4dd77b6074b6 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:08:13.923190 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-405131ea-5620-42ad-a1b3-4dd77b6074b6 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:08:13.930132 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-405131ea-5620-42ad-a1b3-4dd77b6074b6 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:13.930577 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-405131ea-5620-42ad-a1b3-4dd77b6074b6 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:13.931338 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-405131ea-5620-42ad-a1b3-4dd77b6074b6 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:13.931775 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-405131ea-5620-42ad-a1b3-4dd77b6074b6 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:14.064932 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-405131ea-5620-42ad-a1b3-4dd77b6074b6 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:14.073826 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-405131ea-5620-42ad-a1b3-4dd77b6074b6 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1720 microversion: 2.1 time: 0.155566 Jun 07 22:08:14.074394 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 373/762] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:08:13 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:08:14.083935 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-80416369-348d-4a78-9ceb-954097aac6e4 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:08:14.084570 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-80416369-348d-4a78-9ceb-954097aac6e4 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 53059fb5-bea1-4713-94dd-fb6cd8841fe9] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:08:14.091180 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-80416369-348d-4a78-9ceb-954097aac6e4 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:14.091665 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-80416369-348d-4a78-9ceb-954097aac6e4 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:14.092422 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-80416369-348d-4a78-9ceb-954097aac6e4 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:14.092856 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-80416369-348d-4a78-9ceb-954097aac6e4 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:14.219435 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-80416369-348d-4a78-9ceb-954097aac6e4 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:14.227578 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-80416369-348d-4a78-9ceb-954097aac6e4 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/53059fb5-bea1-4713-94dd-fb6cd8841fe9" status: 200 len: 1367 microversion: 2.1 time: 0.147486 Jun 07 22:08:14.228140 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 390/763] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:08:14 2022] GET /compute/v2.1/servers/53059fb5-bea1-4713-94dd-fb6cd8841fe9 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:08:14.269776 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-ac0ed45f-be76-4fa9-8658-5b39192db0ce tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:08:14.270325 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-ac0ed45f-be76-4fa9-8658-5b39192db0ce tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] [instance: 706597ea-671a-4be9-bfda-9ce6e1cfcf30] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:08:14.276287 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-ac0ed45f-be76-4fa9-8658-5b39192db0ce tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:14.276736 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-ac0ed45f-be76-4fa9-8658-5b39192db0ce tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:14.277483 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-ac0ed45f-be76-4fa9-8658-5b39192db0ce tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:14.277920 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-ac0ed45f-be76-4fa9-8658-5b39192db0ce tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:14.403805 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-ac0ed45f-be76-4fa9-8658-5b39192db0ce tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4fc7744b3d4e5fb6e281fcc90cef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b84dd581fc4e9499cfecbb7242e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:14.411199 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-ac0ed45f-be76-4fa9-8658-5b39192db0ce tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] 10.222.0.13 "GET /compute/v2.1/servers/706597ea-671a-4be9-bfda-9ce6e1cfcf30" status: 200 len: 1514 microversion: 2.1 time: 0.145258 Jun 07 22:08:14.411828 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 374/764] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:08:14 2022] GET /compute/v2.1/servers/706597ea-671a-4be9-bfda-9ce6e1cfcf30 => generated 1514 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:08:15.092134 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-99c15f96-83d4-44ae-a84c-d3e7b5149486 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:08:15.092745 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-99c15f96-83d4-44ae-a84c-d3e7b5149486 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:08:15.099484 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-99c15f96-83d4-44ae-a84c-d3e7b5149486 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:15.099964 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-99c15f96-83d4-44ae-a84c-d3e7b5149486 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:15.100899 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-99c15f96-83d4-44ae-a84c-d3e7b5149486 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:15.101619 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-99c15f96-83d4-44ae-a84c-d3e7b5149486 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:15.230061 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-99c15f96-83d4-44ae-a84c-d3e7b5149486 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:15.238029 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-99c15f96-83d4-44ae-a84c-d3e7b5149486 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1720 microversion: 2.1 time: 0.149863 Jun 07 22:08:15.238599 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 391/765] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:08:15 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1720 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:08:15.244570 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-1d405ee7-e27a-4fef-b4eb-85deab0126cb tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:08:15.245182 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-1d405ee7-e27a-4fef-b4eb-85deab0126cb tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 53059fb5-bea1-4713-94dd-fb6cd8841fe9] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:08:15.251256 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1d405ee7-e27a-4fef-b4eb-85deab0126cb tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:15.251743 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1d405ee7-e27a-4fef-b4eb-85deab0126cb tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:15.252503 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1d405ee7-e27a-4fef-b4eb-85deab0126cb tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:15.252941 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1d405ee7-e27a-4fef-b4eb-85deab0126cb tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:15.383460 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-1d405ee7-e27a-4fef-b4eb-85deab0126cb tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:15.390809 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-1d405ee7-e27a-4fef-b4eb-85deab0126cb tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/53059fb5-bea1-4713-94dd-fb6cd8841fe9" status: 200 len: 1367 microversion: 2.1 time: 0.150659 Jun 07 22:08:15.391443 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 375/766] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:08:15 2022] GET /compute/v2.1/servers/53059fb5-bea1-4713-94dd-fb6cd8841fe9 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:08:15.429499 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-5ecd201a-d668-4058-b58b-27fff48f8732 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:08:15.430158 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-5ecd201a-d668-4058-b58b-27fff48f8732 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] [instance: 706597ea-671a-4be9-bfda-9ce6e1cfcf30] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:08:15.436180 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-5ecd201a-d668-4058-b58b-27fff48f8732 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:15.436658 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-5ecd201a-d668-4058-b58b-27fff48f8732 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:15.437413 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-5ecd201a-d668-4058-b58b-27fff48f8732 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:15.437849 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-5ecd201a-d668-4058-b58b-27fff48f8732 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:15.575678 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-5ecd201a-d668-4058-b58b-27fff48f8732 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4fc7744b3d4e5fb6e281fcc90cef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b84dd581fc4e9499cfecbb7242e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:15.583307 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-5ecd201a-d668-4058-b58b-27fff48f8732 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] 10.222.0.13 "GET /compute/v2.1/servers/706597ea-671a-4be9-bfda-9ce6e1cfcf30" status: 200 len: 1514 microversion: 2.1 time: 0.158335 Jun 07 22:08:15.583891 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 392/767] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:08:15 2022] GET /compute/v2.1/servers/706597ea-671a-4be9-bfda-9ce6e1cfcf30 => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:08:16.256130 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-e130a985-e7e4-494e-a26f-f2018e9e2b60 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:08:16.257231 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-e130a985-e7e4-494e-a26f-f2018e9e2b60 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:08:16.264557 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e130a985-e7e4-494e-a26f-f2018e9e2b60 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:16.264930 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e130a985-e7e4-494e-a26f-f2018e9e2b60 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:16.265682 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e130a985-e7e4-494e-a26f-f2018e9e2b60 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:16.266110 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e130a985-e7e4-494e-a26f-f2018e9e2b60 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:16.395168 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-e130a985-e7e4-494e-a26f-f2018e9e2b60 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:16.403880 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-e130a985-e7e4-494e-a26f-f2018e9e2b60 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1720 microversion: 2.1 time: 0.151573 Jun 07 22:08:16.404441 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 376/768] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:08:16 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:08:16.407390 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-cbfaf863-e2e9-4472-9066-ea328034f876 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:08:16.408009 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-cbfaf863-e2e9-4472-9066-ea328034f876 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 53059fb5-bea1-4713-94dd-fb6cd8841fe9] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:08:16.415091 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-cbfaf863-e2e9-4472-9066-ea328034f876 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:16.415574 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-cbfaf863-e2e9-4472-9066-ea328034f876 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:16.416332 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-cbfaf863-e2e9-4472-9066-ea328034f876 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:16.416765 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-cbfaf863-e2e9-4472-9066-ea328034f876 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:16.544777 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-cbfaf863-e2e9-4472-9066-ea328034f876 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:16.552148 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-cbfaf863-e2e9-4472-9066-ea328034f876 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/53059fb5-bea1-4713-94dd-fb6cd8841fe9" status: 200 len: 1367 microversion: 2.1 time: 0.148643 Jun 07 22:08:16.552715 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 393/769] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:08:16 2022] GET /compute/v2.1/servers/53059fb5-bea1-4713-94dd-fb6cd8841fe9 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:08:16.601160 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-2ae41652-6339-47b3-b373-e6393ca9bf3f tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:08:16.602048 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-2ae41652-6339-47b3-b373-e6393ca9bf3f tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] [instance: 706597ea-671a-4be9-bfda-9ce6e1cfcf30] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:08:16.607981 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-2ae41652-6339-47b3-b373-e6393ca9bf3f tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:16.608425 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-2ae41652-6339-47b3-b373-e6393ca9bf3f tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:16.609171 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-2ae41652-6339-47b3-b373-e6393ca9bf3f tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:16.609603 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-2ae41652-6339-47b3-b373-e6393ca9bf3f tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:16.738387 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-2ae41652-6339-47b3-b373-e6393ca9bf3f tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4fc7744b3d4e5fb6e281fcc90cef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b84dd581fc4e9499cfecbb7242e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:16.745962 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-2ae41652-6339-47b3-b373-e6393ca9bf3f tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] 10.222.0.13 "GET /compute/v2.1/servers/706597ea-671a-4be9-bfda-9ce6e1cfcf30" status: 200 len: 1514 microversion: 2.1 time: 0.149246 Jun 07 22:08:16.746550 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 377/770] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:08:16 2022] GET /compute/v2.1/servers/706597ea-671a-4be9-bfda-9ce6e1cfcf30 => generated 1514 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:08:17.420822 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-813b1f7f-ac19-472e-85fb-815f20d561a4 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:08:17.421427 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-813b1f7f-ac19-472e-85fb-815f20d561a4 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:08:17.428010 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-813b1f7f-ac19-472e-85fb-815f20d561a4 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:17.429012 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-813b1f7f-ac19-472e-85fb-815f20d561a4 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:17.429836 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-813b1f7f-ac19-472e-85fb-815f20d561a4 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:17.430348 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-813b1f7f-ac19-472e-85fb-815f20d561a4 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:17.434429 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_cell1:SELECT=100 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:08:17.570186 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-62b3f2b9-4dc7-4d1a-9f20-c180d863cbfd tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:08:17.570984 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-62b3f2b9-4dc7-4d1a-9f20-c180d863cbfd tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 53059fb5-bea1-4713-94dd-fb6cd8841fe9] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:08:17.581019 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-62b3f2b9-4dc7-4d1a-9f20-c180d863cbfd tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:17.581467 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-62b3f2b9-4dc7-4d1a-9f20-c180d863cbfd tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:17.581767 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-813b1f7f-ac19-472e-85fb-815f20d561a4 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:17.586104 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-62b3f2b9-4dc7-4d1a-9f20-c180d863cbfd tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:17.586543 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-62b3f2b9-4dc7-4d1a-9f20-c180d863cbfd tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:17.595700 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-813b1f7f-ac19-472e-85fb-815f20d561a4 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1720 microversion: 2.1 time: 0.178609 Jun 07 22:08:17.596710 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 394/771] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:08:17 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1720 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:08:17.722656 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-62b3f2b9-4dc7-4d1a-9f20-c180d863cbfd tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:17.730878 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-62b3f2b9-4dc7-4d1a-9f20-c180d863cbfd tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/53059fb5-bea1-4713-94dd-fb6cd8841fe9" status: 200 len: 1367 microversion: 2.1 time: 0.165279 Jun 07 22:08:17.731476 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 378/772] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:08:17 2022] GET /compute/v2.1/servers/53059fb5-bea1-4713-94dd-fb6cd8841fe9 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:08:17.763052 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-d2eddb6d-3873-4b0b-adb0-fc10a8809c03 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:08:17.763718 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-d2eddb6d-3873-4b0b-adb0-fc10a8809c03 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] [instance: 706597ea-671a-4be9-bfda-9ce6e1cfcf30] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:08:17.769697 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-d2eddb6d-3873-4b0b-adb0-fc10a8809c03 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:17.770146 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-d2eddb6d-3873-4b0b-adb0-fc10a8809c03 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:17.770901 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-d2eddb6d-3873-4b0b-adb0-fc10a8809c03 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:17.771360 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-d2eddb6d-3873-4b0b-adb0-fc10a8809c03 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:17.897219 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-d2eddb6d-3873-4b0b-adb0-fc10a8809c03 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4fc7744b3d4e5fb6e281fcc90cef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b84dd581fc4e9499cfecbb7242e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:17.905389 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-d2eddb6d-3873-4b0b-adb0-fc10a8809c03 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] 10.222.0.13 "GET /compute/v2.1/servers/706597ea-671a-4be9-bfda-9ce6e1cfcf30" status: 200 len: 1514 microversion: 2.1 time: 0.146157 Jun 07 22:08:17.905962 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 395/773] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:08:17 2022] GET /compute/v2.1/servers/706597ea-671a-4be9-bfda-9ce6e1cfcf30 => generated 1514 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:08:18.613544 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-d09addac-5f05-4fde-879a-bc8973f7b4e3 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:08:18.614204 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-d09addac-5f05-4fde-879a-bc8973f7b4e3 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:08:18.616701 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:08:18.622091 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d09addac-5f05-4fde-879a-bc8973f7b4e3 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:18.622489 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d09addac-5f05-4fde-879a-bc8973f7b4e3 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:18.623247 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d09addac-5f05-4fde-879a-bc8973f7b4e3 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:18.623754 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d09addac-5f05-4fde-879a-bc8973f7b4e3 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:18.748074 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-4484f0e3-c48f-41cc-a518-3f3cf482ae27 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:08:18.748696 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-4484f0e3-c48f-41cc-a518-3f3cf482ae27 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 53059fb5-bea1-4713-94dd-fb6cd8841fe9] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:08:18.755211 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-4484f0e3-c48f-41cc-a518-3f3cf482ae27 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:18.755708 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-4484f0e3-c48f-41cc-a518-3f3cf482ae27 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:18.757002 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-4484f0e3-c48f-41cc-a518-3f3cf482ae27 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:18.757602 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-4484f0e3-c48f-41cc-a518-3f3cf482ae27 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:18.768482 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-d09addac-5f05-4fde-879a-bc8973f7b4e3 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:18.777040 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-d09addac-5f05-4fde-879a-bc8973f7b4e3 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1720 microversion: 2.1 time: 0.167313 Jun 07 22:08:18.777690 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 379/774] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:08:18 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1720 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:08:18.892315 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-4484f0e3-c48f-41cc-a518-3f3cf482ae27 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:18.900571 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-4484f0e3-c48f-41cc-a518-3f3cf482ae27 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/53059fb5-bea1-4713-94dd-fb6cd8841fe9" status: 200 len: 1367 microversion: 2.1 time: 0.156383 Jun 07 22:08:18.901137 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 396/775] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:08:18 2022] GET /compute/v2.1/servers/53059fb5-bea1-4713-94dd-fb6cd8841fe9 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:08:18.921836 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-90a73a25-687b-4295-bc2f-23b7902cbd9a tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:08:18.922440 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-90a73a25-687b-4295-bc2f-23b7902cbd9a tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] [instance: 706597ea-671a-4be9-bfda-9ce6e1cfcf30] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:08:18.929474 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-90a73a25-687b-4295-bc2f-23b7902cbd9a tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:18.929922 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-90a73a25-687b-4295-bc2f-23b7902cbd9a tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:18.930685 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-90a73a25-687b-4295-bc2f-23b7902cbd9a tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:18.931119 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-90a73a25-687b-4295-bc2f-23b7902cbd9a tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:19.070020 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-90a73a25-687b-4295-bc2f-23b7902cbd9a tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4fc7744b3d4e5fb6e281fcc90cef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b84dd581fc4e9499cfecbb7242e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:19.077530 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-90a73a25-687b-4295-bc2f-23b7902cbd9a tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] 10.222.0.13 "GET /compute/v2.1/servers/706597ea-671a-4be9-bfda-9ce6e1cfcf30" status: 200 len: 1514 microversion: 2.1 time: 0.159516 Jun 07 22:08:19.078085 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 380/776] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:08:18 2022] GET /compute/v2.1/servers/706597ea-671a-4be9-bfda-9ce6e1cfcf30 => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:08:19.794479 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-a0c6424f-e21e-435b-b14b-a238045883ce tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:08:19.795104 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-a0c6424f-e21e-435b-b14b-a238045883ce tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:08:19.801785 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a0c6424f-e21e-435b-b14b-a238045883ce tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:19.802288 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a0c6424f-e21e-435b-b14b-a238045883ce tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:19.803187 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a0c6424f-e21e-435b-b14b-a238045883ce tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:19.803768 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a0c6424f-e21e-435b-b14b-a238045883ce tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:19.917982 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-b2d31595-99c6-42fa-a4cb-cccd0d50c008 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:08:19.918744 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-b2d31595-99c6-42fa-a4cb-cccd0d50c008 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 53059fb5-bea1-4713-94dd-fb6cd8841fe9] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:08:19.925323 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-b2d31595-99c6-42fa-a4cb-cccd0d50c008 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:19.925860 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-b2d31595-99c6-42fa-a4cb-cccd0d50c008 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:19.926619 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-b2d31595-99c6-42fa-a4cb-cccd0d50c008 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:19.927055 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-b2d31595-99c6-42fa-a4cb-cccd0d50c008 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:19.936443 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-a0c6424f-e21e-435b-b14b-a238045883ce tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:19.945600 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-a0c6424f-e21e-435b-b14b-a238045883ce tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1720 microversion: 2.1 time: 0.154664 Jun 07 22:08:19.946288 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 397/777] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:08:19 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:08:20.060330 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-b2d31595-99c6-42fa-a4cb-cccd0d50c008 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:20.067659 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-b2d31595-99c6-42fa-a4cb-cccd0d50c008 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/53059fb5-bea1-4713-94dd-fb6cd8841fe9" status: 200 len: 1367 microversion: 2.1 time: 0.154252 Jun 07 22:08:20.068223 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 381/778] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:08:19 2022] GET /compute/v2.1/servers/53059fb5-bea1-4713-94dd-fb6cd8841fe9 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:08:20.093825 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-6567352e-5750-45f3-9b3a-03f086552aa3 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:08:20.094455 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-6567352e-5750-45f3-9b3a-03f086552aa3 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] [instance: 706597ea-671a-4be9-bfda-9ce6e1cfcf30] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:08:20.100526 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-6567352e-5750-45f3-9b3a-03f086552aa3 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:20.101191 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-6567352e-5750-45f3-9b3a-03f086552aa3 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:20.102276 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-6567352e-5750-45f3-9b3a-03f086552aa3 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:20.102706 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-6567352e-5750-45f3-9b3a-03f086552aa3 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:20.243052 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-6567352e-5750-45f3-9b3a-03f086552aa3 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4fc7744b3d4e5fb6e281fcc90cef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b84dd581fc4e9499cfecbb7242e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:20.251793 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-6567352e-5750-45f3-9b3a-03f086552aa3 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] 10.222.0.13 "GET /compute/v2.1/servers/706597ea-671a-4be9-bfda-9ce6e1cfcf30" status: 200 len: 1514 microversion: 2.1 time: 0.161665 Jun 07 22:08:20.252721 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 398/779] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:08:20 2022] GET /compute/v2.1/servers/706597ea-671a-4be9-bfda-9ce6e1cfcf30 => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:08:20.651351 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [req-63223998-dad8-45c5-b7f6-446cc899f546 req-d6af9bfe-6117-4f26-b2a7-21001c5bfc2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "706597ea-671a-4be9-bfda-9ce6e1cfcf30", "name": "network-vif-deleted", "tag": "5cecb3a0-be84-4165-b3b3-786e37122b13"}]} {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:08:20.659280 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [req-63223998-dad8-45c5-b7f6-446cc899f546 req-d6af9bfe-6117-4f26-b2a7-21001c5bfc2d service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:20.659746 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [req-63223998-dad8-45c5-b7f6-446cc899f546 req-d6af9bfe-6117-4f26-b2a7-21001c5bfc2d service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:20.670314 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.compute.server_external_events [req-63223998-dad8-45c5-b7f6-446cc899f546 req-d6af9bfe-6117-4f26-b2a7-21001c5bfc2d service nova] Creating event network-vif-deleted:5cecb3a0-be84-4165-b3b3-786e37122b13 for instance 706597ea-671a-4be9-bfda-9ce6e1cfcf30 on hv-cinder-83552 Jun 07 22:08:20.675021 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [req-63223998-dad8-45c5-b7f6-446cc899f546 req-d6af9bfe-6117-4f26-b2a7-21001c5bfc2d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027418 Jun 07 22:08:20.675627 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 382/780] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:08:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:08:20.963867 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-489aa9a0-6f40-41f5-9db0-e49c55bb8241 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:08:20.964471 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-489aa9a0-6f40-41f5-9db0-e49c55bb8241 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:08:20.970787 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-489aa9a0-6f40-41f5-9db0-e49c55bb8241 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:20.971235 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-489aa9a0-6f40-41f5-9db0-e49c55bb8241 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:20.972055 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-489aa9a0-6f40-41f5-9db0-e49c55bb8241 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:20.972979 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-489aa9a0-6f40-41f5-9db0-e49c55bb8241 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:21.086371 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-4be894b4-7322-4716-bfec-ee3c87d2c4d0 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:08:21.087201 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-4be894b4-7322-4716-bfec-ee3c87d2c4d0 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 53059fb5-bea1-4713-94dd-fb6cd8841fe9] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:08:21.093504 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4be894b4-7322-4716-bfec-ee3c87d2c4d0 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:21.093941 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4be894b4-7322-4716-bfec-ee3c87d2c4d0 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:21.094731 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4be894b4-7322-4716-bfec-ee3c87d2c4d0 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:21.095188 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4be894b4-7322-4716-bfec-ee3c87d2c4d0 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:21.105386 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-489aa9a0-6f40-41f5-9db0-e49c55bb8241 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:21.113890 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-489aa9a0-6f40-41f5-9db0-e49c55bb8241 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1720 microversion: 2.1 time: 0.154298 Jun 07 22:08:21.114652 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 399/781] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:08:20 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:08:21.231315 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-4be894b4-7322-4716-bfec-ee3c87d2c4d0 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:21.238908 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-4be894b4-7322-4716-bfec-ee3c87d2c4d0 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/53059fb5-bea1-4713-94dd-fb6cd8841fe9" status: 200 len: 1558 microversion: 2.1 time: 0.157712 Jun 07 22:08:21.239437 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 383/782] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:08:21 2022] GET /compute/v2.1/servers/53059fb5-bea1-4713-94dd-fb6cd8841fe9 => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:08:21.254972 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-9a6de72f-aec4-4242-9a08-600440cde602 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:08:21.255498 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-9a6de72f-aec4-4242-9a08-600440cde602 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 53059fb5-bea1-4713-94dd-fb6cd8841fe9] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:08:21.261996 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-9a6de72f-aec4-4242-9a08-600440cde602 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:21.262447 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-9a6de72f-aec4-4242-9a08-600440cde602 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:21.263204 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-9a6de72f-aec4-4242-9a08-600440cde602 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:21.263808 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-9a6de72f-aec4-4242-9a08-600440cde602 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:21.270396 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-18f348a5-e89c-45d2-a4b5-aa8e2e672da1 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:08:21.271070 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-18f348a5-e89c-45d2-a4b5-aa8e2e672da1 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] [instance: 706597ea-671a-4be9-bfda-9ce6e1cfcf30] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:08:21.278151 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-18f348a5-e89c-45d2-a4b5-aa8e2e672da1 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:21.278664 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-18f348a5-e89c-45d2-a4b5-aa8e2e672da1 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:21.279512 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-18f348a5-e89c-45d2-a4b5-aa8e2e672da1 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:21.279948 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-18f348a5-e89c-45d2-a4b5-aa8e2e672da1 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:21.345333 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-18f348a5-e89c-45d2-a4b5-aa8e2e672da1 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4fc7744b3d4e5fb6e281fcc90cef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b84dd581fc4e9499cfecbb7242e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:21.349625 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-9a6de72f-aec4-4242-9a08-600440cde602 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/53059fb5-bea1-4713-94dd-fb6cd8841fe9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.098533 Jun 07 22:08:21.350310 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 400/783] 10.222.0.13 () {58 vars in 1274 bytes} [Tue Jun 7 22:08:21 2022] GET /compute/v2.1/servers/53059fb5-bea1-4713-94dd-fb6cd8841fe9/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:08:21.354646 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-18f348a5-e89c-45d2-a4b5-aa8e2e672da1 tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] 10.222.0.13 "GET /compute/v2.1/servers/706597ea-671a-4be9-bfda-9ce6e1cfcf30" status: 200 len: 1303 microversion: 2.1 time: 0.088626 Jun 07 22:08:21.355205 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 384/784] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:08:21 2022] GET /compute/v2.1/servers/706597ea-671a-4be9-bfda-9ce6e1cfcf30 => generated 1303 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:08:22.133130 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-fb7ea9e3-d35f-4623-9e23-b28681ade9e2 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:08:22.133820 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-fb7ea9e3-d35f-4623-9e23-b28681ade9e2 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:08:22.140118 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-fb7ea9e3-d35f-4623-9e23-b28681ade9e2 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:22.140633 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-fb7ea9e3-d35f-4623-9e23-b28681ade9e2 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:22.141452 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-fb7ea9e3-d35f-4623-9e23-b28681ade9e2 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:22.141986 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-fb7ea9e3-d35f-4623-9e23-b28681ade9e2 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:22.273500 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-fb7ea9e3-d35f-4623-9e23-b28681ade9e2 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:22.281629 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-fb7ea9e3-d35f-4623-9e23-b28681ade9e2 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1720 microversion: 2.1 time: 0.153614 Jun 07 22:08:22.282203 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 401/785] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:08:22 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:08:22.371916 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-1ce9c83b-7533-4a56-a3e8-8b7debf12cfa tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:08:22.372532 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-1ce9c83b-7533-4a56-a3e8-8b7debf12cfa tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] [instance: 706597ea-671a-4be9-bfda-9ce6e1cfcf30] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:08:22.378978 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1ce9c83b-7533-4a56-a3e8-8b7debf12cfa tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:22.379560 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1ce9c83b-7533-4a56-a3e8-8b7debf12cfa tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:22.380346 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1ce9c83b-7533-4a56-a3e8-8b7debf12cfa tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:22.380783 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1ce9c83b-7533-4a56-a3e8-8b7debf12cfa tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:22.395153 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.wsgi [None req-1ce9c83b-7533-4a56-a3e8-8b7debf12cfa tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] HTTP exception thrown: Instance 706597ea-671a-4be9-bfda-9ce6e1cfcf30 could not be found. Jun 07 22:08:22.396816 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-1ce9c83b-7533-4a56-a3e8-8b7debf12cfa tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Request method failure captured: Jun 07 22:08:22.396816 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: request: GET /compute/v2.1/servers/706597ea-671a-4be9-bfda-9ce6e1cfcf30 HTTP/1.1 Jun 07 22:08:22.396816 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Accept: application/json Jun 07 22:08:22.396816 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Accept-Encoding: identity Jun 07 22:08:22.396816 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Connection: close Jun 07 22:08:22.396816 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Content-Length: 0 Jun 07 22:08:22.396816 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Content-Type: application/json Jun 07 22:08:22.396816 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Host: 10.222.0.13 Jun 07 22:08:22.396816 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Openstack-System-Scope: None Jun 07 22:08:22.396816 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: User-Agent: python-urllib3/1.26.9 Jun 07 22:08:22.396816 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Auth-Token: gAAAAABin8tZZ7eOPINycaXgfOFYx_8RYsFe5AHLGbaP1lxUe1oG1fKFiABNwrXMVjS9cmcKBfrX73OwlY6fUceKEYgi_hDm_to8R5NJpn1UlJaYGaX4LjHdIHJ6xUmekIZPRdHH5EZE_PrSiLH3eYvMTkzgjsTuV2uBUDnkv4OyvRrToMfBqvg Jun 07 22:08:22.396816 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Domain-Id: None Jun 07 22:08:22.396816 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Domain-Name: None Jun 07 22:08:22.396816 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Identity-Status: Confirmed Jun 07 22:08:22.396816 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Is-Admin-Project: True Jun 07 22:08:22.396816 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Domain-Id: default Jun 07 22:08:22.396816 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Domain-Name: Default Jun 07 22:08:22.396816 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Id: d3b84dd581fc4e9499cfecbb7242e3b3 Jun 07 22:08:22.396816 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1290034794 Jun 07 22:08:22.396816 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Role: member,reader Jun 07 22:08:22.396816 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Roles: member,reader Jun 07 22:08:22.398997 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d3b84dd581fc4e9499cfecbb7242e3b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_d3b84dd581fc4e9499cfecbb7242e3b3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d3b84dd581fc4e9499cfecbb7242e3b3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/d3b84dd581fc4e9499cfecbb7242e3b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}] Jun 07 22:08:22.398997 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Tenant: tempest-VolumesSnapshotTestJSON-1290034794 Jun 07 22:08:22.398997 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Tenant-Id: d3b84dd581fc4e9499cfecbb7242e3b3 Jun 07 22:08:22.398997 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1290034794 Jun 07 22:08:22.398997 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User: tempest-VolumesSnapshotTestJSON-1290034794-project Jun 07 22:08:22.398997 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Domain-Id: default Jun 07 22:08:22.398997 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Domain-Name: Default Jun 07 22:08:22.398997 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Id: fa4fc7744b3d4e5fb6e281fcc90cef5e Jun 07 22:08:22.398997 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Name: tempest-VolumesSnapshotTestJSON-1290034794-project Jun 07 22:08:22.398997 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: method: > Jun 07 22:08:22.398997 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: exception: Instance 706597ea-671a-4be9-bfda-9ce6e1cfcf30 could not be found. Jun 07 22:08:22.398997 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: action_args: {'id': '706597ea-671a-4be9-bfda-9ce6e1cfcf30'} Jun 07 22:08:22.399917 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 22:08:22.399917 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:08:22.399917 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 22:08:22.399917 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 22:08:22.399917 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 22:08:22.399917 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 22:08:22.399917 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 22:08:22.399917 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 22:08:22.399917 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 22:08:22.399917 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 22:08:22.399917 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 706597ea-671a-4be9-bfda-9ce6e1cfcf30 could not be found. Jun 07 22:08:22.399917 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:08:22.399917 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:08:22.399917 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:08:22.399917 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:08:22.399917 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:08:22.399917 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:08:22.399917 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 22:08:22.399917 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 22:08:22.399917 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 22:08:22.401141 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 22:08:22.401141 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 22:08:22.401141 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 22:08:22.401141 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 22:08:22.401141 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 22:08:22.401141 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 22:08:22.401141 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 22:08:22.401141 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 706597ea-671a-4be9-bfda-9ce6e1cfcf30 could not be found. Jun 07 22:08:22.401141 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:08:22.401141 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:08:22.401141 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:08:22.401141 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:08:22.401141 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:08:22.401141 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:08:22.401141 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 22:08:22.401141 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 22:08:22.401141 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 706597ea-671a-4be9-bfda-9ce6e1cfcf30 could not be found. Jun 07 22:08:22.401141 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:08:22.402251 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-1ce9c83b-7533-4a56-a3e8-8b7debf12cfa tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] Returning 404 to user: Instance 706597ea-671a-4be9-bfda-9ce6e1cfcf30 could not be found. {{(pid=117970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 22:08:22.402251 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-1ce9c83b-7533-4a56-a3e8-8b7debf12cfa tempest-VolumesSnapshotTestJSON-1290034794 tempest-VolumesSnapshotTestJSON-1290034794-project] 10.222.0.13 "GET /compute/v2.1/servers/706597ea-671a-4be9-bfda-9ce6e1cfcf30" status: 404 len: 111 microversion: 2.1 time: 0.030722 Jun 07 22:08:22.402251 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 385/786] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:08:22 2022] GET /compute/v2.1/servers/706597ea-671a-4be9-bfda-9ce6e1cfcf30 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 22:08:22.707872 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [req-41aff85d-8349-4a0d-8966-aef3d4101d19 req-432effd9-3866-4512-844b-1c26416a2bb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53059fb5-bea1-4713-94dd-fb6cd8841fe9", "tag": "0b12561e-8139-44a2-93a1-3af2cfa0666e"}]} {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:08:22.717521 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-41aff85d-8349-4a0d-8966-aef3d4101d19 req-432effd9-3866-4512-844b-1c26416a2bb3 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:22.718033 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-41aff85d-8349-4a0d-8966-aef3d4101d19 req-432effd9-3866-4512-844b-1c26416a2bb3 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:22.730365 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.compute.server_external_events [req-41aff85d-8349-4a0d-8966-aef3d4101d19 req-432effd9-3866-4512-844b-1c26416a2bb3 service nova] Creating event network-changed:0b12561e-8139-44a2-93a1-3af2cfa0666e for instance 53059fb5-bea1-4713-94dd-fb6cd8841fe9 on hv-cinder-83552 Jun 07 22:08:22.736168 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [req-41aff85d-8349-4a0d-8966-aef3d4101d19 req-432effd9-3866-4512-844b-1c26416a2bb3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046268 Jun 07 22:08:22.740178 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 402/787] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:08:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:08:23.298495 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-53db87e3-f271-40e9-9224-448ca0f8c647 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:08:23.299923 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-53db87e3-f271-40e9-9224-448ca0f8c647 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:08:23.307179 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-53db87e3-f271-40e9-9224-448ca0f8c647 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:23.307899 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-53db87e3-f271-40e9-9224-448ca0f8c647 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:23.308846 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-53db87e3-f271-40e9-9224-448ca0f8c647 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:23.309445 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-53db87e3-f271-40e9-9224-448ca0f8c647 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:23.471513 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-53db87e3-f271-40e9-9224-448ca0f8c647 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:23.480764 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-53db87e3-f271-40e9-9224-448ca0f8c647 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1720 microversion: 2.1 time: 0.186215 Jun 07 22:08:23.481372 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 386/788] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:08:23 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1720 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:08:24.499470 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-2b54c3d6-59b3-4298-9afe-7545ac8fbe37 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:08:24.500243 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-2b54c3d6-59b3-4298-9afe-7545ac8fbe37 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:08:24.502497 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=1 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:08:24.508561 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-2b54c3d6-59b3-4298-9afe-7545ac8fbe37 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:24.509089 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-2b54c3d6-59b3-4298-9afe-7545ac8fbe37 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:24.509920 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-2b54c3d6-59b3-4298-9afe-7545ac8fbe37 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:24.510441 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-2b54c3d6-59b3-4298-9afe-7545ac8fbe37 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:24.642557 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-2b54c3d6-59b3-4298-9afe-7545ac8fbe37 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:24.650918 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-2b54c3d6-59b3-4298-9afe-7545ac8fbe37 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1720 microversion: 2.1 time: 0.156242 Jun 07 22:08:24.651513 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 403/789] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:08:24 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:08:24.813685 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 22:08:24.814163 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Tue Jun 7 22:08:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 22:08:25.668597 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-ca394855-68e6-4e1e-a6fc-a54e5d387bb0 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:08:25.669207 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-ca394855-68e6-4e1e-a6fc-a54e5d387bb0 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:08:25.675847 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-ca394855-68e6-4e1e-a6fc-a54e5d387bb0 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:25.676295 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-ca394855-68e6-4e1e-a6fc-a54e5d387bb0 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:25.677084 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-ca394855-68e6-4e1e-a6fc-a54e5d387bb0 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:25.677521 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-ca394855-68e6-4e1e-a6fc-a54e5d387bb0 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:25.814379 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-ca394855-68e6-4e1e-a6fc-a54e5d387bb0 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:25.823243 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-ca394855-68e6-4e1e-a6fc-a54e5d387bb0 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1720 microversion: 2.1 time: 0.158556 Jun 07 22:08:25.823890 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 387/790] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:08:25 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:08:27.000488 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-4c6ccec7-3560-4ca9-b49d-03933a85e36e tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:08:27.001129 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-4c6ccec7-3560-4ca9-b49d-03933a85e36e tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:08:27.007109 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-4c6ccec7-3560-4ca9-b49d-03933a85e36e tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:27.007591 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-4c6ccec7-3560-4ca9-b49d-03933a85e36e tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:27.008905 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-4c6ccec7-3560-4ca9-b49d-03933a85e36e tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:27.009331 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-4c6ccec7-3560-4ca9-b49d-03933a85e36e tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:27.138164 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-4c6ccec7-3560-4ca9-b49d-03933a85e36e tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:27.145919 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-4c6ccec7-3560-4ca9-b49d-03933a85e36e tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1720 microversion: 2.1 time: 0.308844 Jun 07 22:08:27.146480 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 404/791] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:08:26 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1720 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:08:28.163021 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-6b549fa1-aad4-4df6-b5ab-6932fe0bb974 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:08:28.163651 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-6b549fa1-aad4-4df6-b5ab-6932fe0bb974 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:08:28.170774 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6b549fa1-aad4-4df6-b5ab-6932fe0bb974 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:28.171225 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6b549fa1-aad4-4df6-b5ab-6932fe0bb974 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:28.172004 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6b549fa1-aad4-4df6-b5ab-6932fe0bb974 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:28.172442 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6b549fa1-aad4-4df6-b5ab-6932fe0bb974 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:28.297980 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-6b549fa1-aad4-4df6-b5ab-6932fe0bb974 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:28.305946 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-6b549fa1-aad4-4df6-b5ab-6932fe0bb974 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1720 microversion: 2.1 time: 0.146718 Jun 07 22:08:28.306508 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 388/792] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:08:28 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1720 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:08:29.322414 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-20624574-3ad8-4402-af0a-52b22f19edde tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:08:29.323011 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-20624574-3ad8-4402-af0a-52b22f19edde tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:08:29.330525 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-20624574-3ad8-4402-af0a-52b22f19edde tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:29.331153 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-20624574-3ad8-4402-af0a-52b22f19edde tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:29.332025 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-20624574-3ad8-4402-af0a-52b22f19edde tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:29.332714 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-20624574-3ad8-4402-af0a-52b22f19edde tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:29.465969 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-20624574-3ad8-4402-af0a-52b22f19edde tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:29.474326 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-20624574-3ad8-4402-af0a-52b22f19edde tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1720 microversion: 2.1 time: 0.155762 Jun 07 22:08:29.474881 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 405/793] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:08:29 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:08:30.491956 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-c18fa8b9-eb75-4133-a2fb-9ca7ac65e2f9 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:08:30.493236 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-c18fa8b9-eb75-4133-a2fb-9ca7ac65e2f9 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:08:30.500981 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c18fa8b9-eb75-4133-a2fb-9ca7ac65e2f9 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:30.501635 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c18fa8b9-eb75-4133-a2fb-9ca7ac65e2f9 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:30.502606 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c18fa8b9-eb75-4133-a2fb-9ca7ac65e2f9 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:30.503431 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c18fa8b9-eb75-4133-a2fb-9ca7ac65e2f9 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:30.662289 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-c18fa8b9-eb75-4133-a2fb-9ca7ac65e2f9 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:30.670887 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-c18fa8b9-eb75-4133-a2fb-9ca7ac65e2f9 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1720 microversion: 2.1 time: 0.182698 Jun 07 22:08:30.671468 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 389/794] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:08:30 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1720 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:08:31.689022 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-2d40898f-b918-4b1d-bcdd-e20ad9ad7f46 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:08:31.689652 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-2d40898f-b918-4b1d-bcdd-e20ad9ad7f46 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:08:31.696176 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-2d40898f-b918-4b1d-bcdd-e20ad9ad7f46 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:31.697871 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-2d40898f-b918-4b1d-bcdd-e20ad9ad7f46 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:31.698993 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-2d40898f-b918-4b1d-bcdd-e20ad9ad7f46 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:31.699472 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-2d40898f-b918-4b1d-bcdd-e20ad9ad7f46 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:31.852213 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-2d40898f-b918-4b1d-bcdd-e20ad9ad7f46 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:31.860699 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-2d40898f-b918-4b1d-bcdd-e20ad9ad7f46 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1697 microversion: 2.1 time: 0.175815 Jun 07 22:08:31.861272 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 406/795] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:08:31 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1697 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:08:31.879882 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-0c2eac3f-aba7-4989-a949-57ee69ee616f tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:08:31.887205 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0c2eac3f-aba7-4989-a949-57ee69ee616f tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:31.887684 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0c2eac3f-aba7-4989-a949-57ee69ee616f tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:31.904740 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:08:31.911288 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-0c2eac3f-aba7-4989-a949-57ee69ee616f tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Going to try to start instance {{(pid=117970) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 07 22:08:31.952399 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-0c2eac3f-aba7-4989-a949-57ee69ee616f tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "POST /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609/action" status: 202 len: 0 microversion: 2.1 time: 0.078010 Jun 07 22:08:31.953174 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 390/796] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Jun 7 22:08:31 2022] POST /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 22:08:31.961594 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-a8e56769-0df7-45e3-abc9-b731731efc31 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:08:31.962419 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-a8e56769-0df7-45e3-abc9-b731731efc31 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:08:31.968787 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a8e56769-0df7-45e3-abc9-b731731efc31 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:31.969215 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a8e56769-0df7-45e3-abc9-b731731efc31 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:31.970041 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a8e56769-0df7-45e3-abc9-b731731efc31 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:31.970479 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a8e56769-0df7-45e3-abc9-b731731efc31 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:32.101689 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-a8e56769-0df7-45e3-abc9-b731731efc31 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:32.110652 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-a8e56769-0df7-45e3-abc9-b731731efc31 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1706 microversion: 2.1 time: 0.152951 Jun 07 22:08:32.111459 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 407/797] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:08:31 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1706 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:08:33.129584 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-fb866a0d-d037-4cbc-a54d-e961e23ce02c tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:08:33.130204 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-fb866a0d-d037-4cbc-a54d-e961e23ce02c tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:08:33.136592 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-fb866a0d-d037-4cbc-a54d-e961e23ce02c tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:33.137040 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-fb866a0d-d037-4cbc-a54d-e961e23ce02c tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:33.137800 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-fb866a0d-d037-4cbc-a54d-e961e23ce02c tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:33.138238 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-fb866a0d-d037-4cbc-a54d-e961e23ce02c tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:33.272574 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-fb866a0d-d037-4cbc-a54d-e961e23ce02c tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:33.280696 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-fb866a0d-d037-4cbc-a54d-e961e23ce02c tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1706 microversion: 2.1 time: 0.155974 Jun 07 22:08:33.281259 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 391/798] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:08:33 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1706 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:08:34.297436 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-c5f7e120-0a7b-411e-883e-1e6c77d7277c tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:08:34.298042 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-c5f7e120-0a7b-411e-883e-1e6c77d7277c tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:08:34.304657 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c5f7e120-0a7b-411e-883e-1e6c77d7277c tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:34.305142 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c5f7e120-0a7b-411e-883e-1e6c77d7277c tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:34.306477 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c5f7e120-0a7b-411e-883e-1e6c77d7277c tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:34.307073 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c5f7e120-0a7b-411e-883e-1e6c77d7277c tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:34.447418 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-c5f7e120-0a7b-411e-883e-1e6c77d7277c tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:34.455747 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-c5f7e120-0a7b-411e-883e-1e6c77d7277c tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1710 microversion: 2.1 time: 0.162009 Jun 07 22:08:34.456240 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 408/799] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:08:34 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1710 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:08:39.658252 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-0a7f795e-77ec-408f-b144-4cb3a5bb7c2b tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:08:39.658748 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-0a7f795e-77ec-408f-b144-4cb3a5bb7c2b tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:08:39.666211 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0a7f795e-77ec-408f-b144-4cb3a5bb7c2b tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:39.666657 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0a7f795e-77ec-408f-b144-4cb3a5bb7c2b tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:39.667441 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0a7f795e-77ec-408f-b144-4cb3a5bb7c2b tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:39.667875 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0a7f795e-77ec-408f-b144-4cb3a5bb7c2b tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:39.696871 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-0a7f795e-77ec-408f-b144-4cb3a5bb7c2b tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95/ips" status: 200 len: 151 microversion: 2.20 time: 0.042382 Jun 07 22:08:39.697622 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 392/800] 10.222.0.13 () {60 vars in 1288 bytes} [Tue Jun 7 22:08:39 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95/ips => generated 151 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 22:08:42.666255 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-468dff28-4307-4b3f-bded-1aebaf2a5c9b tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:08:42.666800 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-468dff28-4307-4b3f-bded-1aebaf2a5c9b tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:08:42.673829 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-468dff28-4307-4b3f-bded-1aebaf2a5c9b tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:42.674273 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-468dff28-4307-4b3f-bded-1aebaf2a5c9b tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:42.675016 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-468dff28-4307-4b3f-bded-1aebaf2a5c9b tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:42.675558 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-468dff28-4307-4b3f-bded-1aebaf2a5c9b tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:42.698750 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.objects.instance [None req-468dff28-4307-4b3f-bded-1aebaf2a5c9b tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lazy-loading 'flavor' on Instance uuid 07abb105-095a-47ad-8761-b5075254ac95 {{(pid=117971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 22:08:42.763980 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:08:42.960923 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-468dff28-4307-4b3f-bded-1aebaf2a5c9b tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "POST /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95/action" status: 202 len: 0 microversion: 2.20 time: 0.298530 Jun 07 22:08:42.961654 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 409/801] 10.222.0.13 () {62 vars in 1318 bytes} [Tue Jun 7 22:08:42 2022] POST /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95/action => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 07 22:08:42.973384 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-3d3c2bb7-e058-43c5-aae7-02b347d069ab tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:08:42.974769 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-3d3c2bb7-e058-43c5-aae7-02b347d069ab tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:08:42.983477 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-3d3c2bb7-e058-43c5-aae7-02b347d069ab tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:42.984533 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-3d3c2bb7-e058-43c5-aae7-02b347d069ab tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:42.985678 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-3d3c2bb7-e058-43c5-aae7-02b347d069ab tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:42.986456 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-3d3c2bb7-e058-43c5-aae7-02b347d069ab tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:43.162666 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-3d3c2bb7-e058-43c5-aae7-02b347d069ab tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:43.173032 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-3d3c2bb7-e058-43c5-aae7-02b347d069ab tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:43.174976 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-3d3c2bb7-e058-43c5-aae7-02b347d069ab tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:43.176448 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-3d3c2bb7-e058-43c5-aae7-02b347d069ab tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1724 microversion: 2.20 time: 0.207730 Jun 07 22:08:43.177407 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 393/802] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:08:42 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1724 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:08:44.198657 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-e205250c-e95b-4a6d-a8a2-995b9b01ec61 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:08:44.199375 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-e205250c-e95b-4a6d-a8a2-995b9b01ec61 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:08:44.205860 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e205250c-e95b-4a6d-a8a2-995b9b01ec61 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:44.206304 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e205250c-e95b-4a6d-a8a2-995b9b01ec61 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:44.207110 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e205250c-e95b-4a6d-a8a2-995b9b01ec61 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:44.207575 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e205250c-e95b-4a6d-a8a2-995b9b01ec61 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:44.336283 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-e205250c-e95b-4a6d-a8a2-995b9b01ec61 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:44.344690 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-e205250c-e95b-4a6d-a8a2-995b9b01ec61 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:44.346184 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-e205250c-e95b-4a6d-a8a2-995b9b01ec61 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:44.347305 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-e205250c-e95b-4a6d-a8a2-995b9b01ec61 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1724 microversion: 2.20 time: 0.153815 Jun 07 22:08:44.347876 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 410/803] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:08:44 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 22:08:45.365233 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-da29b750-8e9b-4312-9950-c6b0e98984ff tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:08:45.365830 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-da29b750-8e9b-4312-9950-c6b0e98984ff tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:08:45.371907 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-da29b750-8e9b-4312-9950-c6b0e98984ff tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:45.372962 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-da29b750-8e9b-4312-9950-c6b0e98984ff tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:45.373856 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-da29b750-8e9b-4312-9950-c6b0e98984ff tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:45.374291 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-da29b750-8e9b-4312-9950-c6b0e98984ff tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:45.507043 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-da29b750-8e9b-4312-9950-c6b0e98984ff tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:45.515640 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-da29b750-8e9b-4312-9950-c6b0e98984ff tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:45.517125 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-da29b750-8e9b-4312-9950-c6b0e98984ff tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:45.518270 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-da29b750-8e9b-4312-9950-c6b0e98984ff tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1724 microversion: 2.20 time: 0.156904 Jun 07 22:08:45.518824 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 394/804] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:08:45 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:08:46.537078 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-aa9b6daa-cf0e-4d35-830d-ed233747f418 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:08:46.537809 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-aa9b6daa-cf0e-4d35-830d-ed233747f418 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:08:46.544464 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-aa9b6daa-cf0e-4d35-830d-ed233747f418 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:46.545125 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-aa9b6daa-cf0e-4d35-830d-ed233747f418 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:46.545886 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-aa9b6daa-cf0e-4d35-830d-ed233747f418 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:46.546314 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-aa9b6daa-cf0e-4d35-830d-ed233747f418 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:46.681985 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-aa9b6daa-cf0e-4d35-830d-ed233747f418 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:46.690514 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-aa9b6daa-cf0e-4d35-830d-ed233747f418 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:46.692049 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-aa9b6daa-cf0e-4d35-830d-ed233747f418 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:46.693192 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-aa9b6daa-cf0e-4d35-830d-ed233747f418 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1724 microversion: 2.20 time: 0.160155 Jun 07 22:08:46.693749 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 411/805] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:08:46 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:08:47.717215 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-fb17e264-fb9f-4ac3-af44-010944c44b03 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:08:47.717215 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-fb17e264-fb9f-4ac3-af44-010944c44b03 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:08:47.718456 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-fb17e264-fb9f-4ac3-af44-010944c44b03 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:47.718908 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-fb17e264-fb9f-4ac3-af44-010944c44b03 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:47.719692 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-fb17e264-fb9f-4ac3-af44-010944c44b03 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:47.720123 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-fb17e264-fb9f-4ac3-af44-010944c44b03 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:47.850980 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-fb17e264-fb9f-4ac3-af44-010944c44b03 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:47.859164 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-fb17e264-fb9f-4ac3-af44-010944c44b03 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:47.860778 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-fb17e264-fb9f-4ac3-af44-010944c44b03 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:47.861935 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-fb17e264-fb9f-4ac3-af44-010944c44b03 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1724 microversion: 2.20 time: 0.155026 Jun 07 22:08:47.862495 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 395/806] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:08:47 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:08:48.880401 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-73d47b6a-3a3d-4ccd-b984-50133270ce4f tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:08:48.881007 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-73d47b6a-3a3d-4ccd-b984-50133270ce4f tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:08:48.887453 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-73d47b6a-3a3d-4ccd-b984-50133270ce4f tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:48.888000 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-73d47b6a-3a3d-4ccd-b984-50133270ce4f tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:48.889106 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-73d47b6a-3a3d-4ccd-b984-50133270ce4f tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:48.889723 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-73d47b6a-3a3d-4ccd-b984-50133270ce4f tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:49.022755 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-73d47b6a-3a3d-4ccd-b984-50133270ce4f tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:49.033925 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-73d47b6a-3a3d-4ccd-b984-50133270ce4f tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:49.036879 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-73d47b6a-3a3d-4ccd-b984-50133270ce4f tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:49.038333 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-73d47b6a-3a3d-4ccd-b984-50133270ce4f tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1724 microversion: 2.20 time: 0.162201 Jun 07 22:08:49.039426 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 412/807] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:08:48 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:08:50.056657 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-c21ee25c-0dc9-40cf-8683-cd477adb145e tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:08:50.057257 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-c21ee25c-0dc9-40cf-8683-cd477adb145e tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:08:50.059765 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_api:SELECT=34 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:08:50.065688 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c21ee25c-0dc9-40cf-8683-cd477adb145e tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:50.066131 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c21ee25c-0dc9-40cf-8683-cd477adb145e tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:50.066878 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c21ee25c-0dc9-40cf-8683-cd477adb145e tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:50.067306 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c21ee25c-0dc9-40cf-8683-cd477adb145e tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:50.213380 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-c21ee25c-0dc9-40cf-8683-cd477adb145e tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:50.221560 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-c21ee25c-0dc9-40cf-8683-cd477adb145e tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:50.223085 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-c21ee25c-0dc9-40cf-8683-cd477adb145e tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:50.224358 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-c21ee25c-0dc9-40cf-8683-cd477adb145e tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1724 microversion: 2.20 time: 0.171459 Jun 07 22:08:50.224931 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 396/808] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:08:50 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:08:51.243626 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-864216e6-8d5b-40f1-a32c-49d310624352 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:08:51.244162 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-864216e6-8d5b-40f1-a32c-49d310624352 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:08:51.250639 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-864216e6-8d5b-40f1-a32c-49d310624352 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:51.251081 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-864216e6-8d5b-40f1-a32c-49d310624352 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:51.251858 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-864216e6-8d5b-40f1-a32c-49d310624352 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:51.252297 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-864216e6-8d5b-40f1-a32c-49d310624352 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:51.386511 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-864216e6-8d5b-40f1-a32c-49d310624352 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:51.394592 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-864216e6-8d5b-40f1-a32c-49d310624352 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:51.396116 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-864216e6-8d5b-40f1-a32c-49d310624352 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:51.397296 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-864216e6-8d5b-40f1-a32c-49d310624352 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1724 microversion: 2.20 time: 0.157764 Jun 07 22:08:51.397847 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 413/809] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:08:51 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:08:52.415277 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-4f9ad2a3-8513-4738-adfc-a9af3a0928a6 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:08:52.415909 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-4f9ad2a3-8513-4738-adfc-a9af3a0928a6 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:08:52.422292 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4f9ad2a3-8513-4738-adfc-a9af3a0928a6 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:52.422733 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4f9ad2a3-8513-4738-adfc-a9af3a0928a6 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:52.423512 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4f9ad2a3-8513-4738-adfc-a9af3a0928a6 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:52.423948 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4f9ad2a3-8513-4738-adfc-a9af3a0928a6 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:52.555985 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-4f9ad2a3-8513-4738-adfc-a9af3a0928a6 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:52.564446 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-4f9ad2a3-8513-4738-adfc-a9af3a0928a6 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:52.565934 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-4f9ad2a3-8513-4738-adfc-a9af3a0928a6 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:52.567073 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-4f9ad2a3-8513-4738-adfc-a9af3a0928a6 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1724 microversion: 2.20 time: 0.155735 Jun 07 22:08:52.567668 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 397/810] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:08:52 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:08:53.586183 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-10fda44b-81d1-4215-bdd9-73180e1d4b45 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:08:53.586792 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-10fda44b-81d1-4215-bdd9-73180e1d4b45 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:08:53.594366 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-10fda44b-81d1-4215-bdd9-73180e1d4b45 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:53.594817 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-10fda44b-81d1-4215-bdd9-73180e1d4b45 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:53.595622 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-10fda44b-81d1-4215-bdd9-73180e1d4b45 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:53.596058 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-10fda44b-81d1-4215-bdd9-73180e1d4b45 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:53.720889 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-10fda44b-81d1-4215-bdd9-73180e1d4b45 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:53.728883 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-10fda44b-81d1-4215-bdd9-73180e1d4b45 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:53.730360 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-10fda44b-81d1-4215-bdd9-73180e1d4b45 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:53.731527 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-10fda44b-81d1-4215-bdd9-73180e1d4b45 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1724 microversion: 2.20 time: 0.149197 Jun 07 22:08:53.732300 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 414/811] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:08:53 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:08:54.749840 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-8d848825-8928-400a-8a08-f7c4db8e32e6 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:08:54.750440 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-8d848825-8928-400a-8a08-f7c4db8e32e6 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:08:54.756883 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-8d848825-8928-400a-8a08-f7c4db8e32e6 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:54.757324 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-8d848825-8928-400a-8a08-f7c4db8e32e6 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:54.758077 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-8d848825-8928-400a-8a08-f7c4db8e32e6 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:54.758506 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-8d848825-8928-400a-8a08-f7c4db8e32e6 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:54.886032 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-8d848825-8928-400a-8a08-f7c4db8e32e6 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:54.894020 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-8d848825-8928-400a-8a08-f7c4db8e32e6 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:54.895577 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-8d848825-8928-400a-8a08-f7c4db8e32e6 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:54.896728 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-8d848825-8928-400a-8a08-f7c4db8e32e6 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1724 microversion: 2.20 time: 0.150978 Jun 07 22:08:54.897289 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 398/812] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:08:54 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:08:55.915670 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-9c87a95e-fffa-4119-ad82-579ae7fc2412 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:08:55.916275 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-9c87a95e-fffa-4119-ad82-579ae7fc2412 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:08:55.918670 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_api:SELECT=24 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:08:55.924473 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-9c87a95e-fffa-4119-ad82-579ae7fc2412 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:55.924915 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-9c87a95e-fffa-4119-ad82-579ae7fc2412 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:55.925671 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-9c87a95e-fffa-4119-ad82-579ae7fc2412 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:55.926105 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-9c87a95e-fffa-4119-ad82-579ae7fc2412 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:56.056879 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-9c87a95e-fffa-4119-ad82-579ae7fc2412 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:56.067045 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-9c87a95e-fffa-4119-ad82-579ae7fc2412 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:56.068580 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-9c87a95e-fffa-4119-ad82-579ae7fc2412 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:56.069736 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-9c87a95e-fffa-4119-ad82-579ae7fc2412 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1724 microversion: 2.20 time: 0.158007 Jun 07 22:08:56.070295 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 415/813] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:08:55 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:08:57.087689 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-e638d935-1bdc-48f7-bf66-414e8e64d497 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:08:57.088297 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-e638d935-1bdc-48f7-bf66-414e8e64d497 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:08:57.095812 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e638d935-1bdc-48f7-bf66-414e8e64d497 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:57.096253 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e638d935-1bdc-48f7-bf66-414e8e64d497 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:57.097000 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e638d935-1bdc-48f7-bf66-414e8e64d497 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:57.097425 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e638d935-1bdc-48f7-bf66-414e8e64d497 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:57.222802 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-e638d935-1bdc-48f7-bf66-414e8e64d497 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:57.230865 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-e638d935-1bdc-48f7-bf66-414e8e64d497 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:57.233030 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-e638d935-1bdc-48f7-bf66-414e8e64d497 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:57.234163 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-e638d935-1bdc-48f7-bf66-414e8e64d497 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1724 microversion: 2.20 time: 0.150439 Jun 07 22:08:57.234730 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 399/814] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:08:57 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 22:08:58.252270 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-54fade98-6dbc-4965-8543-e6de6c88cd6c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:08:58.252885 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-54fade98-6dbc-4965-8543-e6de6c88cd6c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:08:58.259370 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-54fade98-6dbc-4965-8543-e6de6c88cd6c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:58.259828 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-54fade98-6dbc-4965-8543-e6de6c88cd6c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:58.260593 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-54fade98-6dbc-4965-8543-e6de6c88cd6c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:58.261035 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-54fade98-6dbc-4965-8543-e6de6c88cd6c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:58.387314 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-54fade98-6dbc-4965-8543-e6de6c88cd6c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:58.395806 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-54fade98-6dbc-4965-8543-e6de6c88cd6c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:58.397301 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-54fade98-6dbc-4965-8543-e6de6c88cd6c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:58.398449 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-54fade98-6dbc-4965-8543-e6de6c88cd6c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1724 microversion: 2.20 time: 0.150162 Jun 07 22:08:58.399007 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 416/815] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:08:58 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 22:08:59.416906 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-a7ff6d0b-9e7a-4da3-977e-9c5f6719f18d tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:08:59.417511 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-a7ff6d0b-9e7a-4da3-977e-9c5f6719f18d tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:08:59.424692 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a7ff6d0b-9e7a-4da3-977e-9c5f6719f18d tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:59.425137 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a7ff6d0b-9e7a-4da3-977e-9c5f6719f18d tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:59.425885 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a7ff6d0b-9e7a-4da3-977e-9c5f6719f18d tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:08:59.426326 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a7ff6d0b-9e7a-4da3-977e-9c5f6719f18d tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:08:59.565277 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-a7ff6d0b-9e7a-4da3-977e-9c5f6719f18d tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:59.573127 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-a7ff6d0b-9e7a-4da3-977e-9c5f6719f18d tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:59.574648 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-a7ff6d0b-9e7a-4da3-977e-9c5f6719f18d tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:08:59.576427 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-a7ff6d0b-9e7a-4da3-977e-9c5f6719f18d tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1724 microversion: 2.20 time: 0.163397 Jun 07 22:08:59.577178 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 400/816] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:08:59 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:09:00.594724 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-7a51cc65-b07a-4f49-8a31-84bc693ab42f tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:09:00.595266 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-7a51cc65-b07a-4f49-8a31-84bc693ab42f tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:09:00.602230 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-7a51cc65-b07a-4f49-8a31-84bc693ab42f tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:00.602680 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-7a51cc65-b07a-4f49-8a31-84bc693ab42f tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:00.603481 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-7a51cc65-b07a-4f49-8a31-84bc693ab42f tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:00.603917 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-7a51cc65-b07a-4f49-8a31-84bc693ab42f tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:00.743550 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-7a51cc65-b07a-4f49-8a31-84bc693ab42f tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:00.752439 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-7a51cc65-b07a-4f49-8a31-84bc693ab42f tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:00.753925 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-7a51cc65-b07a-4f49-8a31-84bc693ab42f tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:00.755103 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-7a51cc65-b07a-4f49-8a31-84bc693ab42f tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1724 microversion: 2.20 time: 0.164991 Jun 07 22:09:00.755696 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 417/817] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:09:00 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:09:01.777019 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-9d8cdcf7-b379-418c-9b00-316b9282cee6 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:09:01.777620 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-9d8cdcf7-b379-418c-9b00-316b9282cee6 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:09:01.784141 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-9d8cdcf7-b379-418c-9b00-316b9282cee6 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:01.784581 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-9d8cdcf7-b379-418c-9b00-316b9282cee6 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:01.785330 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-9d8cdcf7-b379-418c-9b00-316b9282cee6 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:01.785754 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-9d8cdcf7-b379-418c-9b00-316b9282cee6 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:01.959486 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:09:02.077790 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-9d8cdcf7-b379-418c-9b00-316b9282cee6 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:02.085704 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-9d8cdcf7-b379-418c-9b00-316b9282cee6 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:02.087194 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-9d8cdcf7-b379-418c-9b00-316b9282cee6 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:02.088369 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-9d8cdcf7-b379-418c-9b00-316b9282cee6 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1745 microversion: 2.20 time: 0.315269 Jun 07 22:09:02.088927 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 401/818] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:09:01 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1745 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:09:03.108488 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-691b610f-3c3d-40df-a534-a39536527748 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:09:03.109088 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-691b610f-3c3d-40df-a534-a39536527748 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:09:03.115553 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-691b610f-3c3d-40df-a534-a39536527748 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:03.115990 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-691b610f-3c3d-40df-a534-a39536527748 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:03.116734 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-691b610f-3c3d-40df-a534-a39536527748 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:03.117163 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-691b610f-3c3d-40df-a534-a39536527748 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:03.242464 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-691b610f-3c3d-40df-a534-a39536527748 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:03.250709 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-691b610f-3c3d-40df-a534-a39536527748 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:03.252235 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-691b610f-3c3d-40df-a534-a39536527748 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:03.253386 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-691b610f-3c3d-40df-a534-a39536527748 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1745 microversion: 2.20 time: 0.149853 Jun 07 22:09:03.253940 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 418/819] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:09:03 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1745 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:09:04.271436 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-4646040e-afe2-4768-9c9b-9cca5291b8c4 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:09:04.272048 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-4646040e-afe2-4768-9c9b-9cca5291b8c4 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:09:04.278697 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4646040e-afe2-4768-9c9b-9cca5291b8c4 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:04.279147 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4646040e-afe2-4768-9c9b-9cca5291b8c4 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:04.279934 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4646040e-afe2-4768-9c9b-9cca5291b8c4 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:04.280368 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4646040e-afe2-4768-9c9b-9cca5291b8c4 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:04.407584 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-4646040e-afe2-4768-9c9b-9cca5291b8c4 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:04.415298 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-4646040e-afe2-4768-9c9b-9cca5291b8c4 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:04.416833 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-4646040e-afe2-4768-9c9b-9cca5291b8c4 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:04.417978 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-4646040e-afe2-4768-9c9b-9cca5291b8c4 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1745 microversion: 2.20 time: 0.150514 Jun 07 22:09:04.418532 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 402/820] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:09:04 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1745 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:09:05.437389 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-bfa71a71-5ccc-439f-908f-72d7b39160ea tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:09:05.437990 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-bfa71a71-5ccc-439f-908f-72d7b39160ea tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:09:05.444497 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-bfa71a71-5ccc-439f-908f-72d7b39160ea tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:05.444937 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-bfa71a71-5ccc-439f-908f-72d7b39160ea tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:05.445683 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-bfa71a71-5ccc-439f-908f-72d7b39160ea tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:05.446108 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-bfa71a71-5ccc-439f-908f-72d7b39160ea tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:05.586337 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-bfa71a71-5ccc-439f-908f-72d7b39160ea tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:05.594342 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-bfa71a71-5ccc-439f-908f-72d7b39160ea tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:05.595851 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-bfa71a71-5ccc-439f-908f-72d7b39160ea tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:05.596996 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-bfa71a71-5ccc-439f-908f-72d7b39160ea tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1745 microversion: 2.20 time: 0.164443 Jun 07 22:09:05.597554 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 419/821] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:09:05 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1745 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:09:06.616336 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-6091133a-3060-42fd-94dc-5b6a564dce09 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:09:06.617411 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-6091133a-3060-42fd-94dc-5b6a564dce09 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:09:06.624354 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6091133a-3060-42fd-94dc-5b6a564dce09 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:06.624794 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6091133a-3060-42fd-94dc-5b6a564dce09 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:06.625540 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6091133a-3060-42fd-94dc-5b6a564dce09 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:06.625966 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6091133a-3060-42fd-94dc-5b6a564dce09 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:06.769131 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-6091133a-3060-42fd-94dc-5b6a564dce09 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:06.776985 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-6091133a-3060-42fd-94dc-5b6a564dce09 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:06.778512 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-6091133a-3060-42fd-94dc-5b6a564dce09 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:06.779880 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-6091133a-3060-42fd-94dc-5b6a564dce09 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1745 microversion: 2.20 time: 0.167427 Jun 07 22:09:06.780432 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 403/822] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:09:06 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1745 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:09:06.841385 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [req-99b8fd3d-c1c8-4b4c-929d-1f86090334fc req-f95d387f-a489-4c47-a82c-79891563453c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07abb105-095a-47ad-8761-b5075254ac95", "name": "network-vif-plugged", "status": "completed", "tag": "dfed4201-3c81-4b15-b164-8dd355eaca62"}]} {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:09:06.849380 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-99b8fd3d-c1c8-4b4c-929d-1f86090334fc req-f95d387f-a489-4c47-a82c-79891563453c service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:06.849823 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-99b8fd3d-c1c8-4b4c-929d-1f86090334fc req-f95d387f-a489-4c47-a82c-79891563453c service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:06.860676 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.compute.server_external_events [req-99b8fd3d-c1c8-4b4c-929d-1f86090334fc req-f95d387f-a489-4c47-a82c-79891563453c service nova] Creating event network-vif-plugged:dfed4201-3c81-4b15-b164-8dd355eaca62 for instance 07abb105-095a-47ad-8761-b5075254ac95 on hv-cinder-83552 Jun 07 22:09:06.865574 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [req-99b8fd3d-c1c8-4b4c-929d-1f86090334fc req-f95d387f-a489-4c47-a82c-79891563453c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.219687 Jun 07 22:09:06.866149 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 420/823] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:09:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:09:07.798328 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-10b8fb34-1e2e-478a-b898-c68c1ef8c4c5 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:09:07.798932 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-10b8fb34-1e2e-478a-b898-c68c1ef8c4c5 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:09:07.805629 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-10b8fb34-1e2e-478a-b898-c68c1ef8c4c5 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:07.806078 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-10b8fb34-1e2e-478a-b898-c68c1ef8c4c5 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:07.806836 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-10b8fb34-1e2e-478a-b898-c68c1ef8c4c5 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:07.807269 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-10b8fb34-1e2e-478a-b898-c68c1ef8c4c5 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:07.936609 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-10b8fb34-1e2e-478a-b898-c68c1ef8c4c5 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:07.944420 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-10b8fb34-1e2e-478a-b898-c68c1ef8c4c5 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:07.945907 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-10b8fb34-1e2e-478a-b898-c68c1ef8c4c5 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:07.947057 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-10b8fb34-1e2e-478a-b898-c68c1ef8c4c5 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1745 microversion: 2.20 time: 0.153197 Jun 07 22:09:07.947651 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 404/824] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:09:07 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:09:08.966759 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-68535af1-3bd0-40a2-8d13-94a12faa9463 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:09:08.967508 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-68535af1-3bd0-40a2-8d13-94a12faa9463 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:09:08.973676 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-68535af1-3bd0-40a2-8d13-94a12faa9463 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:08.974121 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-68535af1-3bd0-40a2-8d13-94a12faa9463 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:08.974879 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-68535af1-3bd0-40a2-8d13-94a12faa9463 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:08.975312 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-68535af1-3bd0-40a2-8d13-94a12faa9463 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:09.116777 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-68535af1-3bd0-40a2-8d13-94a12faa9463 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:09.125482 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-68535af1-3bd0-40a2-8d13-94a12faa9463 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:09.126976 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-68535af1-3bd0-40a2-8d13-94a12faa9463 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:09.128157 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-68535af1-3bd0-40a2-8d13-94a12faa9463 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1740 microversion: 2.20 time: 0.167071 Jun 07 22:09:09.128716 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 421/825] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:09:08 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1740 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:09:10.147579 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-34242999-dfaa-4f17-b8f2-28b6b6a301ee tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:09:10.148213 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-34242999-dfaa-4f17-b8f2-28b6b6a301ee tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:09:10.156121 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-34242999-dfaa-4f17-b8f2-28b6b6a301ee tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:10.156858 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-34242999-dfaa-4f17-b8f2-28b6b6a301ee tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:10.158038 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-34242999-dfaa-4f17-b8f2-28b6b6a301ee tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:10.158803 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-34242999-dfaa-4f17-b8f2-28b6b6a301ee tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:10.305985 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-34242999-dfaa-4f17-b8f2-28b6b6a301ee tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:10.314716 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-34242999-dfaa-4f17-b8f2-28b6b6a301ee tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:10.316388 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-34242999-dfaa-4f17-b8f2-28b6b6a301ee tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:10.317834 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-34242999-dfaa-4f17-b8f2-28b6b6a301ee tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1740 microversion: 2.20 time: 0.174143 Jun 07 22:09:10.318704 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 405/826] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:09:10 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1740 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:09:11.337459 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-116eced6-676b-44f4-8e34-a6ca84bebfa9 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:09:11.338315 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-116eced6-676b-44f4-8e34-a6ca84bebfa9 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:09:11.346201 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-116eced6-676b-44f4-8e34-a6ca84bebfa9 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:11.346742 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-116eced6-676b-44f4-8e34-a6ca84bebfa9 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:11.347617 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-116eced6-676b-44f4-8e34-a6ca84bebfa9 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:11.348098 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-116eced6-676b-44f4-8e34-a6ca84bebfa9 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:11.501510 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-116eced6-676b-44f4-8e34-a6ca84bebfa9 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:11.510007 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-116eced6-676b-44f4-8e34-a6ca84bebfa9 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:11.511562 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-116eced6-676b-44f4-8e34-a6ca84bebfa9 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:11.513350 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-116eced6-676b-44f4-8e34-a6ca84bebfa9 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1740 microversion: 2.20 time: 0.179573 Jun 07 22:09:11.515424 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 422/827] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:09:11 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1740 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:09:12.532719 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-69009c38-518b-46d3-9e0b-b8fdd4fb37df tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:09:12.533319 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-69009c38-518b-46d3-9e0b-b8fdd4fb37df tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:09:12.540058 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-69009c38-518b-46d3-9e0b-b8fdd4fb37df tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:12.540502 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-69009c38-518b-46d3-9e0b-b8fdd4fb37df tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:12.541251 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-69009c38-518b-46d3-9e0b-b8fdd4fb37df tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:12.541823 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-69009c38-518b-46d3-9e0b-b8fdd4fb37df tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:12.677572 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-69009c38-518b-46d3-9e0b-b8fdd4fb37df tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:12.687477 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-69009c38-518b-46d3-9e0b-b8fdd4fb37df tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:12.689002 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-69009c38-518b-46d3-9e0b-b8fdd4fb37df tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:12.690153 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-69009c38-518b-46d3-9e0b-b8fdd4fb37df tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1740 microversion: 2.20 time: 0.162128 Jun 07 22:09:12.691453 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 406/828] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:09:12 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1740 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:09:13.708975 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-1e96cd4d-1b4d-4d8a-8a87-a581dab338aa tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:09:13.710101 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-1e96cd4d-1b4d-4d8a-8a87-a581dab338aa tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:09:13.717197 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-1e96cd4d-1b4d-4d8a-8a87-a581dab338aa tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:13.717644 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-1e96cd4d-1b4d-4d8a-8a87-a581dab338aa tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:13.718926 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-1e96cd4d-1b4d-4d8a-8a87-a581dab338aa tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:13.719391 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-1e96cd4d-1b4d-4d8a-8a87-a581dab338aa tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:13.722084 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_cell1:SELECT=75 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:09:13.854644 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-1e96cd4d-1b4d-4d8a-8a87-a581dab338aa tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:13.863793 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-1e96cd4d-1b4d-4d8a-8a87-a581dab338aa tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:13.865402 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-1e96cd4d-1b4d-4d8a-8a87-a581dab338aa tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:13.866559 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-1e96cd4d-1b4d-4d8a-8a87-a581dab338aa tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1740 microversion: 2.20 time: 0.161621 Jun 07 22:09:13.867119 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 423/829] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:09:13 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1740 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:09:14.884802 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-393e7bc0-9fb7-4949-8498-530b7d91d00c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:09:14.885650 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-393e7bc0-9fb7-4949-8498-530b7d91d00c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:09:14.892900 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-393e7bc0-9fb7-4949-8498-530b7d91d00c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:14.893357 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-393e7bc0-9fb7-4949-8498-530b7d91d00c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:14.894130 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-393e7bc0-9fb7-4949-8498-530b7d91d00c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:14.894572 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-393e7bc0-9fb7-4949-8498-530b7d91d00c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:15.039758 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-393e7bc0-9fb7-4949-8498-530b7d91d00c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:15.048974 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-393e7bc0-9fb7-4949-8498-530b7d91d00c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:15.050458 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-393e7bc0-9fb7-4949-8498-530b7d91d00c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:15.051694 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-393e7bc0-9fb7-4949-8498-530b7d91d00c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1740 microversion: 2.20 time: 0.170941 Jun 07 22:09:15.062270 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 407/830] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:09:14 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1740 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 22:09:16.069889 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-5f6bc239-7d93-4995-8847-a2f9e9200129 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:09:16.070696 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-5f6bc239-7d93-4995-8847-a2f9e9200129 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:09:16.079083 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-5f6bc239-7d93-4995-8847-a2f9e9200129 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:16.079689 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-5f6bc239-7d93-4995-8847-a2f9e9200129 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:16.080646 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-5f6bc239-7d93-4995-8847-a2f9e9200129 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:16.081575 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-5f6bc239-7d93-4995-8847-a2f9e9200129 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:16.232116 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-5f6bc239-7d93-4995-8847-a2f9e9200129 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:16.241132 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-5f6bc239-7d93-4995-8847-a2f9e9200129 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:16.242398 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-5f6bc239-7d93-4995-8847-a2f9e9200129 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:16.243597 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-5f6bc239-7d93-4995-8847-a2f9e9200129 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1740 microversion: 2.20 time: 0.177615 Jun 07 22:09:16.244336 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 424/831] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:09:16 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1740 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:09:17.262058 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-eb1e27a9-da99-4781-b612-24b7167b4fe0 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:09:17.264513 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-eb1e27a9-da99-4781-b612-24b7167b4fe0 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:09:17.271532 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-eb1e27a9-da99-4781-b612-24b7167b4fe0 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:17.271981 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-eb1e27a9-da99-4781-b612-24b7167b4fe0 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:17.272743 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-eb1e27a9-da99-4781-b612-24b7167b4fe0 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:17.273179 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-eb1e27a9-da99-4781-b612-24b7167b4fe0 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:17.426633 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-eb1e27a9-da99-4781-b612-24b7167b4fe0 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:17.435854 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-eb1e27a9-da99-4781-b612-24b7167b4fe0 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:17.437455 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-eb1e27a9-da99-4781-b612-24b7167b4fe0 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:17.438756 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-eb1e27a9-da99-4781-b612-24b7167b4fe0 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1740 microversion: 2.20 time: 0.180710 Jun 07 22:09:17.439590 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 408/832] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:09:17 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1740 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:09:18.459420 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-97f029d0-6328-463c-b584-5585a4b5498b tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:09:18.460043 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-97f029d0-6328-463c-b584-5585a4b5498b tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:09:18.466982 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-97f029d0-6328-463c-b584-5585a4b5498b tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:18.467469 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-97f029d0-6328-463c-b584-5585a4b5498b tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:18.468243 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-97f029d0-6328-463c-b584-5585a4b5498b tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:18.468684 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-97f029d0-6328-463c-b584-5585a4b5498b tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:18.625135 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-97f029d0-6328-463c-b584-5585a4b5498b tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:18.634319 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-97f029d0-6328-463c-b584-5585a4b5498b tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:18.636031 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-97f029d0-6328-463c-b584-5585a4b5498b tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:18.637376 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-97f029d0-6328-463c-b584-5585a4b5498b tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1740 microversion: 2.20 time: 0.183231 Jun 07 22:09:18.647358 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 425/833] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:09:18 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1740 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:09:19.659144 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-84b598bc-c941-463b-9c9c-9dc3fe4e1de2 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:09:19.659855 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-84b598bc-c941-463b-9c9c-9dc3fe4e1de2 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:09:19.667748 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-84b598bc-c941-463b-9c9c-9dc3fe4e1de2 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:19.669527 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-84b598bc-c941-463b-9c9c-9dc3fe4e1de2 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:19.670675 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-84b598bc-c941-463b-9c9c-9dc3fe4e1de2 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:19.671124 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-84b598bc-c941-463b-9c9c-9dc3fe4e1de2 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:19.811602 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-84b598bc-c941-463b-9c9c-9dc3fe4e1de2 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:19.822153 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-84b598bc-c941-463b-9c9c-9dc3fe4e1de2 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:19.823931 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-84b598bc-c941-463b-9c9c-9dc3fe4e1de2 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:19.825723 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-84b598bc-c941-463b-9c9c-9dc3fe4e1de2 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1740 microversion: 2.20 time: 0.171314 Jun 07 22:09:19.836280 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 409/834] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:09:19 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1740 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:09:20.844329 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-59d8ebe5-465c-4275-a870-ceea7aad12c3 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:09:20.846186 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-59d8ebe5-465c-4275-a870-ceea7aad12c3 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:09:20.853934 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-59d8ebe5-465c-4275-a870-ceea7aad12c3 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:20.854377 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-59d8ebe5-465c-4275-a870-ceea7aad12c3 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:20.855135 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-59d8ebe5-465c-4275-a870-ceea7aad12c3 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:20.855591 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-59d8ebe5-465c-4275-a870-ceea7aad12c3 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:20.990881 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-59d8ebe5-465c-4275-a870-ceea7aad12c3 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:21.000626 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-59d8ebe5-465c-4275-a870-ceea7aad12c3 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:21.002139 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-59d8ebe5-465c-4275-a870-ceea7aad12c3 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:21.003341 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-59d8ebe5-465c-4275-a870-ceea7aad12c3 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1740 microversion: 2.20 time: 0.163694 Jun 07 22:09:21.004134 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 426/835] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:09:20 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1740 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:09:22.022027 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-b0ca840d-6d1f-4b9f-ba1a-5e8c8633b3c6 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:09:22.022778 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-b0ca840d-6d1f-4b9f-ba1a-5e8c8633b3c6 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:09:22.025268 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_api:SELECT=28 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:09:22.031054 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-b0ca840d-6d1f-4b9f-ba1a-5e8c8633b3c6 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:22.031533 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-b0ca840d-6d1f-4b9f-ba1a-5e8c8633b3c6 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:22.032291 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-b0ca840d-6d1f-4b9f-ba1a-5e8c8633b3c6 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:22.032729 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-b0ca840d-6d1f-4b9f-ba1a-5e8c8633b3c6 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:22.174263 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-b0ca840d-6d1f-4b9f-ba1a-5e8c8633b3c6 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:22.182088 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-b0ca840d-6d1f-4b9f-ba1a-5e8c8633b3c6 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:22.183611 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-b0ca840d-6d1f-4b9f-ba1a-5e8c8633b3c6 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:22.184770 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-b0ca840d-6d1f-4b9f-ba1a-5e8c8633b3c6 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1722 microversion: 2.20 time: 0.166732 Jun 07 22:09:22.185332 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 410/836] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:09:22 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:09:23.203213 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-9b5585ed-0ce4-42ae-b5e6-cbf34fb91b3f tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:09:23.203854 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-9b5585ed-0ce4-42ae-b5e6-cbf34fb91b3f tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:09:23.210333 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-9b5585ed-0ce4-42ae-b5e6-cbf34fb91b3f tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:23.210784 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-9b5585ed-0ce4-42ae-b5e6-cbf34fb91b3f tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:23.211575 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-9b5585ed-0ce4-42ae-b5e6-cbf34fb91b3f tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:23.212010 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-9b5585ed-0ce4-42ae-b5e6-cbf34fb91b3f tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:23.354886 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-9b5585ed-0ce4-42ae-b5e6-cbf34fb91b3f tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:23.363756 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-9b5585ed-0ce4-42ae-b5e6-cbf34fb91b3f tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:23.365240 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-9b5585ed-0ce4-42ae-b5e6-cbf34fb91b3f tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:23.366393 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-9b5585ed-0ce4-42ae-b5e6-cbf34fb91b3f tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1722 microversion: 2.20 time: 0.167355 Jun 07 22:09:23.366953 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 427/837] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:09:23 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:09:24.384736 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-fb8b59e9-897b-44f7-a9ee-d257f5aed801 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:09:24.385347 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-fb8b59e9-897b-44f7-a9ee-d257f5aed801 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:09:24.392256 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-fb8b59e9-897b-44f7-a9ee-d257f5aed801 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:24.392708 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-fb8b59e9-897b-44f7-a9ee-d257f5aed801 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:24.393463 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-fb8b59e9-897b-44f7-a9ee-d257f5aed801 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:24.393911 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-fb8b59e9-897b-44f7-a9ee-d257f5aed801 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:24.530078 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-fb8b59e9-897b-44f7-a9ee-d257f5aed801 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:24.537991 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-fb8b59e9-897b-44f7-a9ee-d257f5aed801 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:24.539515 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-fb8b59e9-897b-44f7-a9ee-d257f5aed801 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:24.540671 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-fb8b59e9-897b-44f7-a9ee-d257f5aed801 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1665 microversion: 2.20 time: 0.159864 Jun 07 22:09:24.541236 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 411/838] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:09:24 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1665 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:09:24.560035 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-c34af7f7-16b8-4030-bc82-d513b9f53c48 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8dcad951-3f5e-450d-bc7a-2e66067591bc"}} {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:09:24.561410 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-c34af7f7-16b8-4030-bc82-d513b9f53c48 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:09:24.569027 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c34af7f7-16b8-4030-bc82-d513b9f53c48 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:24.569590 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c34af7f7-16b8-4030-bc82-d513b9f53c48 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:24.570565 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c34af7f7-16b8-4030-bc82-d513b9f53c48 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:24.571137 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c34af7f7-16b8-4030-bc82-d513b9f53c48 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:24.698475 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [req-c47420ab-6e98-4fc4-abee-d40a1a95a091 req-dddfac1e-8022-4574-b6cb-b87b30a2b0f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07abb105-095a-47ad-8761-b5075254ac95", "name": "network-vif-unplugged", "status": "completed", "tag": "dfed4201-3c81-4b15-b164-8dd355eaca62"}]} {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:09:24.709192 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [req-c47420ab-6e98-4fc4-abee-d40a1a95a091 req-dddfac1e-8022-4574-b6cb-b87b30a2b0f5 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:24.709952 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [req-c47420ab-6e98-4fc4-abee-d40a1a95a091 req-dddfac1e-8022-4574-b6cb-b87b30a2b0f5 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:24.728509 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.compute.server_external_events [req-c47420ab-6e98-4fc4-abee-d40a1a95a091 req-dddfac1e-8022-4574-b6cb-b87b30a2b0f5 service nova] Unable to find a host for instance 07abb105-095a-47ad-8761-b5075254ac95. Dropping event network-vif-unplugged {{(pid=117970) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 07 22:09:24.729866 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [req-c47420ab-6e98-4fc4-abee-d40a1a95a091 req-dddfac1e-8022-4574-b6cb-b87b30a2b0f5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.034995 Jun 07 22:09:24.731605 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 412/839] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:09:24 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 37 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jun 07 22:09:24.879765 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-c34af7f7-16b8-4030-bc82-d513b9f53c48 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "POST /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.325188 Jun 07 22:09:24.883311 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 428/840] 10.222.0.13 () {62 vars in 1363 bytes} [Tue Jun 7 22:09:24 2022] POST /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95/os-volume_attachments => generated 188 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 22:09:24.997784 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-69559c88-b199-40e3-99d9-df9b2357c00c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:09:24.998412 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-69559c88-b199-40e3-99d9-df9b2357c00c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:09:25.004662 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-69559c88-b199-40e3-99d9-df9b2357c00c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:25.005109 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-69559c88-b199-40e3-99d9-df9b2357c00c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:25.005872 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-69559c88-b199-40e3-99d9-df9b2357c00c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:25.006308 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-69559c88-b199-40e3-99d9-df9b2357c00c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:25.198225 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-69559c88-b199-40e3-99d9-df9b2357c00c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "POST /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95/action" status: 202 len: 0 microversion: 2.20 time: 0.205043 Jun 07 22:09:25.198966 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 413/841] 10.222.0.13 () {62 vars in 1318 bytes} [Tue Jun 7 22:09:24 2022] POST /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95/action => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 07 22:09:25.207178 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-cc30a839-7df5-42dc-89bf-574de136286e tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:09:25.207840 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-cc30a839-7df5-42dc-89bf-574de136286e tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:09:25.214426 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-cc30a839-7df5-42dc-89bf-574de136286e tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:25.215074 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-cc30a839-7df5-42dc-89bf-574de136286e tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:25.216481 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-cc30a839-7df5-42dc-89bf-574de136286e tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:25.216917 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-cc30a839-7df5-42dc-89bf-574de136286e tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:25.347602 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-cc30a839-7df5-42dc-89bf-574de136286e tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:25.356837 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-cc30a839-7df5-42dc-89bf-574de136286e tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:25.358354 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-cc30a839-7df5-42dc-89bf-574de136286e tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:25.359542 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-cc30a839-7df5-42dc-89bf-574de136286e tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1751 microversion: 2.20 time: 0.156300 Jun 07 22:09:25.360098 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 429/842] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:09:25 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1751 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:09:26.379117 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-89fdb6af-c630-4b8e-93e6-c852824ce94e tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:09:26.379674 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-89fdb6af-c630-4b8e-93e6-c852824ce94e tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:09:26.385885 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-89fdb6af-c630-4b8e-93e6-c852824ce94e tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:26.386350 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-89fdb6af-c630-4b8e-93e6-c852824ce94e tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:26.388274 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-89fdb6af-c630-4b8e-93e6-c852824ce94e tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:26.388573 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-89fdb6af-c630-4b8e-93e6-c852824ce94e tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:26.520526 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-89fdb6af-c630-4b8e-93e6-c852824ce94e tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:26.528914 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-89fdb6af-c630-4b8e-93e6-c852824ce94e tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:26.530403 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-89fdb6af-c630-4b8e-93e6-c852824ce94e tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:26.531594 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-89fdb6af-c630-4b8e-93e6-c852824ce94e tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1751 microversion: 2.20 time: 0.157141 Jun 07 22:09:26.532173 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 414/843] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:09:26 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1751 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:09:27.550278 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-66115384-2bb4-4ed1-90d4-084ce45641dd tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:09:27.550924 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-66115384-2bb4-4ed1-90d4-084ce45641dd tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:09:27.553352 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_api:SELECT=30 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:09:27.558946 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-66115384-2bb4-4ed1-90d4-084ce45641dd tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:27.559938 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-66115384-2bb4-4ed1-90d4-084ce45641dd tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:27.560756 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-66115384-2bb4-4ed1-90d4-084ce45641dd tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:27.561198 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-66115384-2bb4-4ed1-90d4-084ce45641dd tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:27.704356 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-66115384-2bb4-4ed1-90d4-084ce45641dd tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:27.712659 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-66115384-2bb4-4ed1-90d4-084ce45641dd tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:27.714149 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-66115384-2bb4-4ed1-90d4-084ce45641dd tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:27.715823 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-66115384-2bb4-4ed1-90d4-084ce45641dd tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1751 microversion: 2.20 time: 0.168960 Jun 07 22:09:27.716408 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 430/844] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:09:27 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1751 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:09:28.734147 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-d1bce6ef-2793-48af-8d55-28db1cefa8e5 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:09:28.734749 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-d1bce6ef-2793-48af-8d55-28db1cefa8e5 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:09:28.741280 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d1bce6ef-2793-48af-8d55-28db1cefa8e5 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:28.741723 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d1bce6ef-2793-48af-8d55-28db1cefa8e5 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:28.742475 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d1bce6ef-2793-48af-8d55-28db1cefa8e5 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:28.742907 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d1bce6ef-2793-48af-8d55-28db1cefa8e5 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:28.877433 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-d1bce6ef-2793-48af-8d55-28db1cefa8e5 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:28.886590 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-d1bce6ef-2793-48af-8d55-28db1cefa8e5 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:28.889330 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-d1bce6ef-2793-48af-8d55-28db1cefa8e5 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:28.890479 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-d1bce6ef-2793-48af-8d55-28db1cefa8e5 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1751 microversion: 2.20 time: 0.161003 Jun 07 22:09:28.891163 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 415/845] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:09:28 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1751 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 22:09:29.910080 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-12f89e0c-0cd5-463e-bfa9-a5f1953d6701 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:09:29.910827 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-12f89e0c-0cd5-463e-bfa9-a5f1953d6701 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:09:29.920085 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-12f89e0c-0cd5-463e-bfa9-a5f1953d6701 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:29.920644 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-12f89e0c-0cd5-463e-bfa9-a5f1953d6701 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:29.921578 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-12f89e0c-0cd5-463e-bfa9-a5f1953d6701 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:29.922150 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-12f89e0c-0cd5-463e-bfa9-a5f1953d6701 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:30.057707 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-12f89e0c-0cd5-463e-bfa9-a5f1953d6701 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:30.068842 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-12f89e0c-0cd5-463e-bfa9-a5f1953d6701 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:30.070752 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-12f89e0c-0cd5-463e-bfa9-a5f1953d6701 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:30.072158 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-12f89e0c-0cd5-463e-bfa9-a5f1953d6701 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1751 microversion: 2.20 time: 0.167392 Jun 07 22:09:30.072820 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 431/846] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:09:29 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1751 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:09:31.092024 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-96143e67-aa95-428a-ae35-07d9eab5915f tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:09:31.092782 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-96143e67-aa95-428a-ae35-07d9eab5915f tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:09:31.099949 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-96143e67-aa95-428a-ae35-07d9eab5915f tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:31.100415 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-96143e67-aa95-428a-ae35-07d9eab5915f tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:31.101172 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-96143e67-aa95-428a-ae35-07d9eab5915f tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:31.102016 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-96143e67-aa95-428a-ae35-07d9eab5915f tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:31.237303 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-96143e67-aa95-428a-ae35-07d9eab5915f tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:31.246112 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-96143e67-aa95-428a-ae35-07d9eab5915f tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:31.248326 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-96143e67-aa95-428a-ae35-07d9eab5915f tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:31.249495 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-96143e67-aa95-428a-ae35-07d9eab5915f tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1753 microversion: 2.20 time: 0.161663 Jun 07 22:09:31.250044 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 416/847] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:09:31 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1753 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:09:32.269072 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-227c5826-b278-4345-b603-add1250dfab3 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:09:32.269774 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-227c5826-b278-4345-b603-add1250dfab3 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:09:32.276458 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-227c5826-b278-4345-b603-add1250dfab3 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:32.276904 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-227c5826-b278-4345-b603-add1250dfab3 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:32.277779 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-227c5826-b278-4345-b603-add1250dfab3 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:32.278212 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-227c5826-b278-4345-b603-add1250dfab3 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:32.410140 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-227c5826-b278-4345-b603-add1250dfab3 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:32.418671 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-227c5826-b278-4345-b603-add1250dfab3 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:32.420178 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-227c5826-b278-4345-b603-add1250dfab3 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:32.421323 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-227c5826-b278-4345-b603-add1250dfab3 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1809 microversion: 2.20 time: 0.156232 Jun 07 22:09:32.421879 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 432/848] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:09:32 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:09:33.439829 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-7bf452e3-d27d-4f6f-bf28-92d0af29947b tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:09:33.440469 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-7bf452e3-d27d-4f6f-bf28-92d0af29947b tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:09:33.446899 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-7bf452e3-d27d-4f6f-bf28-92d0af29947b tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:33.447367 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-7bf452e3-d27d-4f6f-bf28-92d0af29947b tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:33.448138 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-7bf452e3-d27d-4f6f-bf28-92d0af29947b tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:33.448570 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-7bf452e3-d27d-4f6f-bf28-92d0af29947b tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:33.472721 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:09:33.596499 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-7bf452e3-d27d-4f6f-bf28-92d0af29947b tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:33.605485 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-7bf452e3-d27d-4f6f-bf28-92d0af29947b tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:33.607099 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-7bf452e3-d27d-4f6f-bf28-92d0af29947b tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:33.608295 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-7bf452e3-d27d-4f6f-bf28-92d0af29947b tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1809 microversion: 2.20 time: 0.172340 Jun 07 22:09:33.608864 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 417/849] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:09:33 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 22:09:34.626317 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-14ba2149-cc99-49bb-8040-672b1a7831e3 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:09:34.626942 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-14ba2149-cc99-49bb-8040-672b1a7831e3 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:09:34.633511 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-14ba2149-cc99-49bb-8040-672b1a7831e3 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:34.633957 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-14ba2149-cc99-49bb-8040-672b1a7831e3 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:34.634711 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-14ba2149-cc99-49bb-8040-672b1a7831e3 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:34.635149 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-14ba2149-cc99-49bb-8040-672b1a7831e3 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:34.775452 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-14ba2149-cc99-49bb-8040-672b1a7831e3 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:34.784686 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-14ba2149-cc99-49bb-8040-672b1a7831e3 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:34.786222 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-14ba2149-cc99-49bb-8040-672b1a7831e3 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:34.787416 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-14ba2149-cc99-49bb-8040-672b1a7831e3 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1809 microversion: 2.20 time: 0.165162 Jun 07 22:09:34.787998 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 433/850] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:09:34 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:09:35.806073 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-0d22ea27-5e98-4f29-9b51-a6e5fb5dbd00 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:09:35.806651 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-0d22ea27-5e98-4f29-9b51-a6e5fb5dbd00 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:09:35.817916 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0d22ea27-5e98-4f29-9b51-a6e5fb5dbd00 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:35.818381 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0d22ea27-5e98-4f29-9b51-a6e5fb5dbd00 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:35.819161 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0d22ea27-5e98-4f29-9b51-a6e5fb5dbd00 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:35.819624 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0d22ea27-5e98-4f29-9b51-a6e5fb5dbd00 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:35.961133 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-0d22ea27-5e98-4f29-9b51-a6e5fb5dbd00 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:35.970778 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-0d22ea27-5e98-4f29-9b51-a6e5fb5dbd00 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:35.972557 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-0d22ea27-5e98-4f29-9b51-a6e5fb5dbd00 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:35.974308 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-0d22ea27-5e98-4f29-9b51-a6e5fb5dbd00 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1809 microversion: 2.20 time: 0.172137 Jun 07 22:09:35.975001 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 418/851] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:09:35 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:09:36.993416 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-7d5b3e1c-153a-4965-81dc-86fb4a9baa91 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:09:36.994064 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-7d5b3e1c-153a-4965-81dc-86fb4a9baa91 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:09:37.000875 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-7d5b3e1c-153a-4965-81dc-86fb4a9baa91 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:37.001325 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-7d5b3e1c-153a-4965-81dc-86fb4a9baa91 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:37.002185 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-7d5b3e1c-153a-4965-81dc-86fb4a9baa91 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:37.002627 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-7d5b3e1c-153a-4965-81dc-86fb4a9baa91 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:37.151993 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-7d5b3e1c-153a-4965-81dc-86fb4a9baa91 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:37.164316 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-7d5b3e1c-153a-4965-81dc-86fb4a9baa91 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:37.165895 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-7d5b3e1c-153a-4965-81dc-86fb4a9baa91 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:37.167131 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-7d5b3e1c-153a-4965-81dc-86fb4a9baa91 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1809 microversion: 2.20 time: 0.177727 Jun 07 22:09:37.167782 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 434/852] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:09:36 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:09:37.830825 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-22ef4668-9d52-43db-b1b5-9fc57bfcaa49 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:09:37.832005 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-22ef4668-9d52-43db-b1b5-9fc57bfcaa49 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:09:37.839494 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-22ef4668-9d52-43db-b1b5-9fc57bfcaa49 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:37.839951 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-22ef4668-9d52-43db-b1b5-9fc57bfcaa49 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:37.841341 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-22ef4668-9d52-43db-b1b5-9fc57bfcaa49 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:37.841914 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-22ef4668-9d52-43db-b1b5-9fc57bfcaa49 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:37.925754 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-22ef4668-9d52-43db-b1b5-9fc57bfcaa49 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "POST /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b/action" status: 202 len: 0 microversion: 2.1 time: 0.098988 Jun 07 22:09:37.929071 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 419/853] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Jun 7 22:09:37 2022] POST /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 22:09:37.934621 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-76c8079e-52ff-4b52-8ecd-cd59783d3eef tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:09:37.935351 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-76c8079e-52ff-4b52-8ecd-cd59783d3eef tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:09:37.942439 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-76c8079e-52ff-4b52-8ecd-cd59783d3eef tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:37.942961 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-76c8079e-52ff-4b52-8ecd-cd59783d3eef tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:37.943789 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-76c8079e-52ff-4b52-8ecd-cd59783d3eef tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:37.944255 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-76c8079e-52ff-4b52-8ecd-cd59783d3eef tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:38.101933 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-76c8079e-52ff-4b52-8ecd-cd59783d3eef tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af02cd6ffd0484c8f6569629cd6313c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31cd38d46643fbac516d21ee4f89ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:38.112463 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-76c8079e-52ff-4b52-8ecd-cd59783d3eef tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b" status: 200 len: 1748 microversion: 2.1 time: 0.181485 Jun 07 22:09:38.113898 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 435/854] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:09:37 2022] GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b => generated 1748 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:09:38.187559 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-58067426-9ab0-476b-8fbe-00e567604e6c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:09:38.188252 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-58067426-9ab0-476b-8fbe-00e567604e6c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:09:38.194650 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-58067426-9ab0-476b-8fbe-00e567604e6c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:38.195096 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-58067426-9ab0-476b-8fbe-00e567604e6c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:38.196201 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-58067426-9ab0-476b-8fbe-00e567604e6c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:38.196633 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-58067426-9ab0-476b-8fbe-00e567604e6c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:38.337461 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-58067426-9ab0-476b-8fbe-00e567604e6c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:38.346981 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-58067426-9ab0-476b-8fbe-00e567604e6c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:38.348496 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-58067426-9ab0-476b-8fbe-00e567604e6c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:38.349669 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-58067426-9ab0-476b-8fbe-00e567604e6c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1809 microversion: 2.20 time: 0.167214 Jun 07 22:09:38.350220 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 420/855] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:09:38 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:09:39.132563 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-ad3f215c-f5f8-4fcd-bba8-110f627e6e8d tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:09:39.133382 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-ad3f215c-f5f8-4fcd-bba8-110f627e6e8d tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:09:39.142436 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ad3f215c-f5f8-4fcd-bba8-110f627e6e8d tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:39.143200 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ad3f215c-f5f8-4fcd-bba8-110f627e6e8d tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:39.144013 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ad3f215c-f5f8-4fcd-bba8-110f627e6e8d tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:39.144932 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ad3f215c-f5f8-4fcd-bba8-110f627e6e8d tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:39.297345 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-ad3f215c-f5f8-4fcd-bba8-110f627e6e8d tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af02cd6ffd0484c8f6569629cd6313c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31cd38d46643fbac516d21ee4f89ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:39.305662 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-ad3f215c-f5f8-4fcd-bba8-110f627e6e8d tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b" status: 200 len: 1748 microversion: 2.1 time: 0.176953 Jun 07 22:09:39.306229 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 436/856] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:09:39 2022] GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b => generated 1748 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:09:39.370416 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-376e24f8-c6fc-4f79-a74f-f825b24b72d1 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:09:39.371133 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-376e24f8-c6fc-4f79-a74f-f825b24b72d1 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:09:39.378130 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-376e24f8-c6fc-4f79-a74f-f825b24b72d1 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:39.378588 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-376e24f8-c6fc-4f79-a74f-f825b24b72d1 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:39.379417 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-376e24f8-c6fc-4f79-a74f-f825b24b72d1 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:39.379846 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-376e24f8-c6fc-4f79-a74f-f825b24b72d1 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:39.517503 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-376e24f8-c6fc-4f79-a74f-f825b24b72d1 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:39.526238 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-376e24f8-c6fc-4f79-a74f-f825b24b72d1 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:39.528405 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-376e24f8-c6fc-4f79-a74f-f825b24b72d1 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:39.529588 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-376e24f8-c6fc-4f79-a74f-f825b24b72d1 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1809 microversion: 2.20 time: 0.164285 Jun 07 22:09:39.530161 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 421/857] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:09:39 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:09:39.860869 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-e944ccc9-4f5c-4e6d-ab73-f7a5160de2a5 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c193041b-a5dc-4a50-8b11-76dadfb0deec"}} {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:09:39.861970 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-e944ccc9-4f5c-4e6d-ab73-f7a5160de2a5 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: f84b4686-8e5c-49af-b5ad-13f37e20f976] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:09:39.867850 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e944ccc9-4f5c-4e6d-ab73-f7a5160de2a5 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:39.868343 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e944ccc9-4f5c-4e6d-ab73-f7a5160de2a5 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:39.869064 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e944ccc9-4f5c-4e6d-ab73-f7a5160de2a5 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:39.869468 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e944ccc9-4f5c-4e6d-ab73-f7a5160de2a5 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:39.873185 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:09:40.323647 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-2178650c-5e7b-47c3-8608-73fbec4e8882 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:09:40.324357 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-2178650c-5e7b-47c3-8608-73fbec4e8882 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:09:40.331075 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-2178650c-5e7b-47c3-8608-73fbec4e8882 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:40.331551 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-2178650c-5e7b-47c3-8608-73fbec4e8882 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:40.332316 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-2178650c-5e7b-47c3-8608-73fbec4e8882 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:40.332751 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-2178650c-5e7b-47c3-8608-73fbec4e8882 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:40.494314 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-2178650c-5e7b-47c3-8608-73fbec4e8882 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af02cd6ffd0484c8f6569629cd6313c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31cd38d46643fbac516d21ee4f89ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:40.503100 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-2178650c-5e7b-47c3-8608-73fbec4e8882 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b" status: 200 len: 1748 microversion: 2.1 time: 0.183922 Jun 07 22:09:40.503788 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 422/858] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:09:40 2022] GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b => generated 1748 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:09:40.548527 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-3a93a0d6-ab5f-4f80-9148-2035818da5c3 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:09:40.549135 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-3a93a0d6-ab5f-4f80-9148-2035818da5c3 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:09:40.555281 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-3a93a0d6-ab5f-4f80-9148-2035818da5c3 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:40.555763 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-3a93a0d6-ab5f-4f80-9148-2035818da5c3 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:40.556536 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-3a93a0d6-ab5f-4f80-9148-2035818da5c3 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:40.556971 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-3a93a0d6-ab5f-4f80-9148-2035818da5c3 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:40.717024 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-3a93a0d6-ab5f-4f80-9148-2035818da5c3 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:40.725801 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-3a93a0d6-ab5f-4f80-9148-2035818da5c3 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:40.727593 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-3a93a0d6-ab5f-4f80-9148-2035818da5c3 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:40.728773 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-3a93a0d6-ab5f-4f80-9148-2035818da5c3 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1809 microversion: 2.20 time: 0.184250 Jun 07 22:09:40.729336 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 423/859] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:09:40 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1809 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 22:09:41.520269 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-542e0f84-bb0b-482a-978c-51d8fb2c1c0c tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:09:41.521040 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-542e0f84-bb0b-482a-978c-51d8fb2c1c0c tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:09:41.527315 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-542e0f84-bb0b-482a-978c-51d8fb2c1c0c tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:41.527824 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-542e0f84-bb0b-482a-978c-51d8fb2c1c0c tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:41.528580 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-542e0f84-bb0b-482a-978c-51d8fb2c1c0c tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:41.529015 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-542e0f84-bb0b-482a-978c-51d8fb2c1c0c tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:41.675569 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-542e0f84-bb0b-482a-978c-51d8fb2c1c0c tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af02cd6ffd0484c8f6569629cd6313c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31cd38d46643fbac516d21ee4f89ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:41.684914 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-542e0f84-bb0b-482a-978c-51d8fb2c1c0c tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b" status: 200 len: 1748 microversion: 2.1 time: 0.167847 Jun 07 22:09:41.686879 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 424/860] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:09:41 2022] GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b => generated 1748 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:09:41.748868 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-6f3e6195-0823-43aa-9e16-66dc9783e4c3 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:09:41.749476 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-6f3e6195-0823-43aa-9e16-66dc9783e4c3 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:09:41.756126 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6f3e6195-0823-43aa-9e16-66dc9783e4c3 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:41.756715 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6f3e6195-0823-43aa-9e16-66dc9783e4c3 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:41.757491 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6f3e6195-0823-43aa-9e16-66dc9783e4c3 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:41.757946 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6f3e6195-0823-43aa-9e16-66dc9783e4c3 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:41.892873 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-6f3e6195-0823-43aa-9e16-66dc9783e4c3 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:41.901136 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-6f3e6195-0823-43aa-9e16-66dc9783e4c3 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:41.903180 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-6f3e6195-0823-43aa-9e16-66dc9783e4c3 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:41.904447 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-6f3e6195-0823-43aa-9e16-66dc9783e4c3 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1809 microversion: 2.20 time: 0.160193 Jun 07 22:09:41.905011 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 425/861] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:09:41 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 22:09:42.702419 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-45e63493-e0eb-4023-be9f-222b681796b4 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:09:42.703065 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-45e63493-e0eb-4023-be9f-222b681796b4 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:09:42.709545 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-45e63493-e0eb-4023-be9f-222b681796b4 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:42.709989 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-45e63493-e0eb-4023-be9f-222b681796b4 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:42.710738 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-45e63493-e0eb-4023-be9f-222b681796b4 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:42.711169 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-45e63493-e0eb-4023-be9f-222b681796b4 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:42.852553 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-45e63493-e0eb-4023-be9f-222b681796b4 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af02cd6ffd0484c8f6569629cd6313c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31cd38d46643fbac516d21ee4f89ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:42.860752 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-45e63493-e0eb-4023-be9f-222b681796b4 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b" status: 200 len: 1748 microversion: 2.1 time: 0.162939 Jun 07 22:09:42.861358 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 426/862] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:09:42 2022] GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b => generated 1748 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:09:42.921732 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-222fd860-fc80-476a-ab91-ab3c2c5c7ba6 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:09:42.922958 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-222fd860-fc80-476a-ab91-ab3c2c5c7ba6 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:09:42.928982 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-222fd860-fc80-476a-ab91-ab3c2c5c7ba6 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:42.929429 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-222fd860-fc80-476a-ab91-ab3c2c5c7ba6 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:42.930178 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-222fd860-fc80-476a-ab91-ab3c2c5c7ba6 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:42.930611 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-222fd860-fc80-476a-ab91-ab3c2c5c7ba6 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:43.061264 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-222fd860-fc80-476a-ab91-ab3c2c5c7ba6 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:43.069581 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-222fd860-fc80-476a-ab91-ab3c2c5c7ba6 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:43.071074 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-222fd860-fc80-476a-ab91-ab3c2c5c7ba6 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:43.072258 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-222fd860-fc80-476a-ab91-ab3c2c5c7ba6 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1809 microversion: 2.20 time: 0.154339 Jun 07 22:09:43.072818 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 427/863] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:09:42 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 22:09:43.878501 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-c591a24c-5eae-4ee1-b533-2e859ac90c75 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:09:43.879151 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-c591a24c-5eae-4ee1-b533-2e859ac90c75 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:09:43.885561 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c591a24c-5eae-4ee1-b533-2e859ac90c75 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:43.886002 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c591a24c-5eae-4ee1-b533-2e859ac90c75 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:43.886747 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c591a24c-5eae-4ee1-b533-2e859ac90c75 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:43.887204 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c591a24c-5eae-4ee1-b533-2e859ac90c75 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:44.025644 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-c591a24c-5eae-4ee1-b533-2e859ac90c75 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af02cd6ffd0484c8f6569629cd6313c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31cd38d46643fbac516d21ee4f89ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:44.033539 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-c591a24c-5eae-4ee1-b533-2e859ac90c75 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b" status: 200 len: 1748 microversion: 2.1 time: 0.158881 Jun 07 22:09:44.034114 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 428/864] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:09:43 2022] GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b => generated 1748 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:09:44.090051 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-4531f554-5855-4593-9756-014792118fdb tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:09:44.090850 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-4531f554-5855-4593-9756-014792118fdb tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:09:44.096851 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4531f554-5855-4593-9756-014792118fdb tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:44.097334 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4531f554-5855-4593-9756-014792118fdb tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:44.098093 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4531f554-5855-4593-9756-014792118fdb tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:44.098535 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4531f554-5855-4593-9756-014792118fdb tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:44.230029 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-4531f554-5855-4593-9756-014792118fdb tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:44.239013 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-4531f554-5855-4593-9756-014792118fdb tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:44.240556 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-4531f554-5855-4593-9756-014792118fdb tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:44.241721 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-4531f554-5855-4593-9756-014792118fdb tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1809 microversion: 2.20 time: 0.155702 Jun 07 22:09:44.242287 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 429/865] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:09:44 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 22:09:45.050770 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-ba54b0f2-3d71-4169-83fd-8e67bfcc8e29 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:09:45.051608 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-ba54b0f2-3d71-4169-83fd-8e67bfcc8e29 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:09:45.057982 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-ba54b0f2-3d71-4169-83fd-8e67bfcc8e29 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:45.058435 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-ba54b0f2-3d71-4169-83fd-8e67bfcc8e29 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:45.059581 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-ba54b0f2-3d71-4169-83fd-8e67bfcc8e29 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:45.060430 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-ba54b0f2-3d71-4169-83fd-8e67bfcc8e29 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:45.208807 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-ba54b0f2-3d71-4169-83fd-8e67bfcc8e29 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af02cd6ffd0484c8f6569629cd6313c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31cd38d46643fbac516d21ee4f89ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:45.217375 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-ba54b0f2-3d71-4169-83fd-8e67bfcc8e29 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b" status: 200 len: 1748 microversion: 2.1 time: 0.170732 Jun 07 22:09:45.217946 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 430/866] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:09:45 2022] GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b => generated 1748 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:09:45.260017 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-2301a261-a8c1-4998-b5bc-b419717b7a9c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:09:45.260622 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-2301a261-a8c1-4998-b5bc-b419717b7a9c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:09:45.267113 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-2301a261-a8c1-4998-b5bc-b419717b7a9c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:45.267598 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-2301a261-a8c1-4998-b5bc-b419717b7a9c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:45.268357 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-2301a261-a8c1-4998-b5bc-b419717b7a9c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:45.268793 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-2301a261-a8c1-4998-b5bc-b419717b7a9c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:45.401792 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-2301a261-a8c1-4998-b5bc-b419717b7a9c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:45.410811 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-2301a261-a8c1-4998-b5bc-b419717b7a9c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:45.412328 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-2301a261-a8c1-4998-b5bc-b419717b7a9c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:45.413482 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-2301a261-a8c1-4998-b5bc-b419717b7a9c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1809 microversion: 2.20 time: 0.157140 Jun 07 22:09:45.414046 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 431/867] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:09:45 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 22:09:46.235413 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-559c289c-9b66-4eb1-aa06-bbc4191e3f74 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:09:46.236131 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-559c289c-9b66-4eb1-aa06-bbc4191e3f74 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:09:46.242564 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-559c289c-9b66-4eb1-aa06-bbc4191e3f74 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:46.243005 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-559c289c-9b66-4eb1-aa06-bbc4191e3f74 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:46.243778 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-559c289c-9b66-4eb1-aa06-bbc4191e3f74 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:46.244208 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-559c289c-9b66-4eb1-aa06-bbc4191e3f74 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:46.388952 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-559c289c-9b66-4eb1-aa06-bbc4191e3f74 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af02cd6ffd0484c8f6569629cd6313c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31cd38d46643fbac516d21ee4f89ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:46.392719 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:09:46.404333 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-559c289c-9b66-4eb1-aa06-bbc4191e3f74 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b" status: 200 len: 1748 microversion: 2.1 time: 0.173318 Jun 07 22:09:46.404927 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 432/868] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:09:46 2022] GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b => generated 1748 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:09:46.437268 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-eaa5cd12-ee5e-4d34-9b58-85ee37cfbcf5 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:09:46.438332 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-eaa5cd12-ee5e-4d34-9b58-85ee37cfbcf5 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:09:46.448126 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-eaa5cd12-ee5e-4d34-9b58-85ee37cfbcf5 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:46.448807 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-eaa5cd12-ee5e-4d34-9b58-85ee37cfbcf5 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:46.449917 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-eaa5cd12-ee5e-4d34-9b58-85ee37cfbcf5 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:46.450660 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-eaa5cd12-ee5e-4d34-9b58-85ee37cfbcf5 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:46.604845 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-eaa5cd12-ee5e-4d34-9b58-85ee37cfbcf5 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:46.613768 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-eaa5cd12-ee5e-4d34-9b58-85ee37cfbcf5 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:46.615240 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-eaa5cd12-ee5e-4d34-9b58-85ee37cfbcf5 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:46.616410 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-eaa5cd12-ee5e-4d34-9b58-85ee37cfbcf5 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1809 microversion: 2.20 time: 0.187671 Jun 07 22:09:46.616968 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 433/869] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:09:46 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1809 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:09:46.846027 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-e944ccc9-4f5c-4e6d-ab73-f7a5160de2a5 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "POST /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 7.111608 Jun 07 22:09:46.851263 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 437/870] 10.222.0.13 () {60 vars in 1322 bytes} [Tue Jun 7 22:09:39 2022] POST /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976/os-volume_attachments => generated 194 bytes in 7113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:09:47.425076 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-43ff70d0-a23b-45f2-a8ca-51deee678933 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:09:47.425712 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-43ff70d0-a23b-45f2-a8ca-51deee678933 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:09:47.432143 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-43ff70d0-a23b-45f2-a8ca-51deee678933 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:47.432594 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-43ff70d0-a23b-45f2-a8ca-51deee678933 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:47.433360 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-43ff70d0-a23b-45f2-a8ca-51deee678933 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:47.433951 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-43ff70d0-a23b-45f2-a8ca-51deee678933 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:47.580188 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-43ff70d0-a23b-45f2-a8ca-51deee678933 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af02cd6ffd0484c8f6569629cd6313c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31cd38d46643fbac516d21ee4f89ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:47.589096 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-43ff70d0-a23b-45f2-a8ca-51deee678933 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b" status: 200 len: 1753 microversion: 2.1 time: 0.167898 Jun 07 22:09:47.589672 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 434/871] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:09:47 2022] GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b => generated 1753 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:09:47.635344 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-fb0fae08-4403-4c25-a24e-f6605a9c49ba tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:09:47.636027 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-fb0fae08-4403-4c25-a24e-f6605a9c49ba tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:09:47.643454 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-fb0fae08-4403-4c25-a24e-f6605a9c49ba tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:47.643898 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-fb0fae08-4403-4c25-a24e-f6605a9c49ba tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:47.644653 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-fb0fae08-4403-4c25-a24e-f6605a9c49ba tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:47.645085 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-fb0fae08-4403-4c25-a24e-f6605a9c49ba tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:47.778527 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-fb0fae08-4403-4c25-a24e-f6605a9c49ba tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:47.786868 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-fb0fae08-4403-4c25-a24e-f6605a9c49ba tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:47.788393 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-fb0fae08-4403-4c25-a24e-f6605a9c49ba tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:47.789539 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-fb0fae08-4403-4c25-a24e-f6605a9c49ba tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1809 microversion: 2.20 time: 0.158974 Jun 07 22:09:47.790090 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 438/872] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:09:47 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:09:48.607308 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-0eeb4cd3-e22a-45c7-aaa6-ebab59ba6462 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:09:48.607935 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-0eeb4cd3-e22a-45c7-aaa6-ebab59ba6462 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:09:48.614376 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0eeb4cd3-e22a-45c7-aaa6-ebab59ba6462 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:48.614823 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0eeb4cd3-e22a-45c7-aaa6-ebab59ba6462 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:48.615605 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0eeb4cd3-e22a-45c7-aaa6-ebab59ba6462 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:48.616041 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0eeb4cd3-e22a-45c7-aaa6-ebab59ba6462 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:48.766361 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-0eeb4cd3-e22a-45c7-aaa6-ebab59ba6462 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af02cd6ffd0484c8f6569629cd6313c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31cd38d46643fbac516d21ee4f89ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:48.774332 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-0eeb4cd3-e22a-45c7-aaa6-ebab59ba6462 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b" status: 200 len: 1753 microversion: 2.1 time: 0.170986 Jun 07 22:09:48.774890 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 435/873] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:09:48 2022] GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b => generated 1753 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:09:48.808445 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-43f45776-06f9-4b66-8cc6-5ba9d0dc5189 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:09:48.809597 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-43f45776-06f9-4b66-8cc6-5ba9d0dc5189 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:09:48.816179 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-43f45776-06f9-4b66-8cc6-5ba9d0dc5189 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:48.816624 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-43f45776-06f9-4b66-8cc6-5ba9d0dc5189 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:48.817377 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-43f45776-06f9-4b66-8cc6-5ba9d0dc5189 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:48.817811 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-43f45776-06f9-4b66-8cc6-5ba9d0dc5189 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:48.945801 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-43f45776-06f9-4b66-8cc6-5ba9d0dc5189 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:48.955087 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-43f45776-06f9-4b66-8cc6-5ba9d0dc5189 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:48.956704 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-43f45776-06f9-4b66-8cc6-5ba9d0dc5189 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:48.958196 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-43f45776-06f9-4b66-8cc6-5ba9d0dc5189 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1809 microversion: 2.20 time: 0.153681 Jun 07 22:09:48.959141 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 439/874] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:09:48 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:09:49.791680 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-01376436-bb59-401c-a49f-8e9b29cbd0c0 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:09:49.792286 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-01376436-bb59-401c-a49f-8e9b29cbd0c0 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:09:49.799312 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-01376436-bb59-401c-a49f-8e9b29cbd0c0 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:49.799781 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-01376436-bb59-401c-a49f-8e9b29cbd0c0 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:49.800533 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-01376436-bb59-401c-a49f-8e9b29cbd0c0 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:49.800969 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-01376436-bb59-401c-a49f-8e9b29cbd0c0 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:49.945353 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-01376436-bb59-401c-a49f-8e9b29cbd0c0 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af02cd6ffd0484c8f6569629cd6313c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31cd38d46643fbac516d21ee4f89ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:49.953216 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-01376436-bb59-401c-a49f-8e9b29cbd0c0 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b" status: 200 len: 1753 microversion: 2.1 time: 0.165563 Jun 07 22:09:49.953783 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 436/875] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:09:49 2022] GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b => generated 1753 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:09:49.976061 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-517497cb-739b-46ac-bf24-77b3a61d1978 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:09:49.976921 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-517497cb-739b-46ac-bf24-77b3a61d1978 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:09:49.984623 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-517497cb-739b-46ac-bf24-77b3a61d1978 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:49.985067 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-517497cb-739b-46ac-bf24-77b3a61d1978 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:49.985815 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-517497cb-739b-46ac-bf24-77b3a61d1978 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:49.986499 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-517497cb-739b-46ac-bf24-77b3a61d1978 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:50.127166 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-517497cb-739b-46ac-bf24-77b3a61d1978 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:50.135962 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-517497cb-739b-46ac-bf24-77b3a61d1978 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:50.138189 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-517497cb-739b-46ac-bf24-77b3a61d1978 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:50.139429 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-517497cb-739b-46ac-bf24-77b3a61d1978 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1809 microversion: 2.20 time: 0.167163 Jun 07 22:09:50.140000 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 440/876] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:09:49 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:09:50.970442 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-a38560ad-fa69-4788-8ffa-a2f6c585492b tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:09:50.971046 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-a38560ad-fa69-4788-8ffa-a2f6c585492b tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:09:50.977753 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a38560ad-fa69-4788-8ffa-a2f6c585492b tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:50.978193 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a38560ad-fa69-4788-8ffa-a2f6c585492b tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:50.978935 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a38560ad-fa69-4788-8ffa-a2f6c585492b tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:50.979395 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a38560ad-fa69-4788-8ffa-a2f6c585492b tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:51.127224 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-a38560ad-fa69-4788-8ffa-a2f6c585492b tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af02cd6ffd0484c8f6569629cd6313c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31cd38d46643fbac516d21ee4f89ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:51.135095 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-a38560ad-fa69-4788-8ffa-a2f6c585492b tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b" status: 200 len: 1753 microversion: 2.1 time: 0.168760 Jun 07 22:09:51.135681 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 437/877] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:09:50 2022] GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b => generated 1753 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:09:51.157326 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-bc594df8-a1e7-4b96-a941-0c6a53524488 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:09:51.157964 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-bc594df8-a1e7-4b96-a941-0c6a53524488 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:09:51.164470 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-bc594df8-a1e7-4b96-a941-0c6a53524488 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:51.164916 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-bc594df8-a1e7-4b96-a941-0c6a53524488 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:51.165671 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-bc594df8-a1e7-4b96-a941-0c6a53524488 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:51.166103 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-bc594df8-a1e7-4b96-a941-0c6a53524488 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:51.301021 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-bc594df8-a1e7-4b96-a941-0c6a53524488 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:51.310269 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-bc594df8-a1e7-4b96-a941-0c6a53524488 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:51.311821 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-bc594df8-a1e7-4b96-a941-0c6a53524488 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:51.312980 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-bc594df8-a1e7-4b96-a941-0c6a53524488 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1809 microversion: 2.20 time: 0.159588 Jun 07 22:09:51.313550 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 441/878] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:09:51 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:09:52.151800 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-107518f5-3f09-419c-94b0-ae7bd160c6ed tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:09:52.153013 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-107518f5-3f09-419c-94b0-ae7bd160c6ed tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:09:52.155383 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_api:SELECT=58 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:09:52.161608 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-107518f5-3f09-419c-94b0-ae7bd160c6ed tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:52.165970 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-107518f5-3f09-419c-94b0-ae7bd160c6ed tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:52.167100 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-107518f5-3f09-419c-94b0-ae7bd160c6ed tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:52.167663 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-107518f5-3f09-419c-94b0-ae7bd160c6ed tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:52.312123 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-107518f5-3f09-419c-94b0-ae7bd160c6ed tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af02cd6ffd0484c8f6569629cd6313c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31cd38d46643fbac516d21ee4f89ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:52.320000 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-107518f5-3f09-419c-94b0-ae7bd160c6ed tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b" status: 200 len: 1753 microversion: 2.1 time: 0.172101 Jun 07 22:09:52.320569 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 438/879] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:09:52 2022] GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b => generated 1753 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:09:52.331739 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-e148d0ec-6be3-4298-8351-531ea9bcfac7 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:09:52.332407 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-e148d0ec-6be3-4298-8351-531ea9bcfac7 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:09:52.339349 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e148d0ec-6be3-4298-8351-531ea9bcfac7 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:52.340547 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e148d0ec-6be3-4298-8351-531ea9bcfac7 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:52.341250 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e148d0ec-6be3-4298-8351-531ea9bcfac7 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:52.341811 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e148d0ec-6be3-4298-8351-531ea9bcfac7 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:52.474273 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-e148d0ec-6be3-4298-8351-531ea9bcfac7 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:52.485978 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-e148d0ec-6be3-4298-8351-531ea9bcfac7 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:52.487526 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-e148d0ec-6be3-4298-8351-531ea9bcfac7 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:52.488894 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-e148d0ec-6be3-4298-8351-531ea9bcfac7 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1809 microversion: 2.20 time: 0.161200 Jun 07 22:09:52.489947 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 442/880] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:09:52 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:09:53.393560 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-5a1bcd9b-1edb-4dcc-9d82-d570bc54cd84 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:09:53.394170 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-5a1bcd9b-1edb-4dcc-9d82-d570bc54cd84 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:09:53.400740 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-5a1bcd9b-1edb-4dcc-9d82-d570bc54cd84 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:53.401184 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-5a1bcd9b-1edb-4dcc-9d82-d570bc54cd84 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:53.401933 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-5a1bcd9b-1edb-4dcc-9d82-d570bc54cd84 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:53.403295 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-5a1bcd9b-1edb-4dcc-9d82-d570bc54cd84 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:53.510091 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-122faa27-0679-4ee6-bbf1-9a251060f9c3 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:09:53.510706 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-122faa27-0679-4ee6-bbf1-9a251060f9c3 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:09:53.518039 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-122faa27-0679-4ee6-bbf1-9a251060f9c3 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:53.518502 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-122faa27-0679-4ee6-bbf1-9a251060f9c3 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:53.519275 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-122faa27-0679-4ee6-bbf1-9a251060f9c3 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:53.519743 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-122faa27-0679-4ee6-bbf1-9a251060f9c3 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:53.544536 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-5a1bcd9b-1edb-4dcc-9d82-d570bc54cd84 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af02cd6ffd0484c8f6569629cd6313c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31cd38d46643fbac516d21ee4f89ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:53.552714 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-5a1bcd9b-1edb-4dcc-9d82-d570bc54cd84 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b" status: 200 len: 1753 microversion: 2.1 time: 0.163015 Jun 07 22:09:53.553390 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 439/881] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:09:53 2022] GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:09:53.650442 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-122faa27-0679-4ee6-bbf1-9a251060f9c3 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:53.659186 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-122faa27-0679-4ee6-bbf1-9a251060f9c3 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:53.660695 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-122faa27-0679-4ee6-bbf1-9a251060f9c3 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:53.661851 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-122faa27-0679-4ee6-bbf1-9a251060f9c3 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1809 microversion: 2.20 time: 0.155772 Jun 07 22:09:53.662409 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 443/882] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:09:53 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:09:54.570633 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-0059d15a-effa-49e4-bdcd-3c5e0ef08f87 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:09:54.571471 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-0059d15a-effa-49e4-bdcd-3c5e0ef08f87 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:09:54.581680 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0059d15a-effa-49e4-bdcd-3c5e0ef08f87 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:54.582205 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0059d15a-effa-49e4-bdcd-3c5e0ef08f87 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:54.583280 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0059d15a-effa-49e4-bdcd-3c5e0ef08f87 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:54.583866 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0059d15a-effa-49e4-bdcd-3c5e0ef08f87 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:54.680043 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-65472951-0a22-4794-9a87-0888c46ac13a tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:09:54.680767 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-65472951-0a22-4794-9a87-0888c46ac13a tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:09:54.687493 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-65472951-0a22-4794-9a87-0888c46ac13a tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:54.688024 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-65472951-0a22-4794-9a87-0888c46ac13a tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:54.688864 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-65472951-0a22-4794-9a87-0888c46ac13a tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:54.689375 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-65472951-0a22-4794-9a87-0888c46ac13a tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:54.737823 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-0059d15a-effa-49e4-bdcd-3c5e0ef08f87 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af02cd6ffd0484c8f6569629cd6313c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31cd38d46643fbac516d21ee4f89ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:54.745829 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-0059d15a-effa-49e4-bdcd-3c5e0ef08f87 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b" status: 200 len: 1753 microversion: 2.1 time: 0.179675 Jun 07 22:09:54.746625 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 440/883] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:09:54 2022] GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b => generated 1753 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:09:54.820042 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-65472951-0a22-4794-9a87-0888c46ac13a tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:54.828421 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-65472951-0a22-4794-9a87-0888c46ac13a tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:54.829946 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-65472951-0a22-4794-9a87-0888c46ac13a tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:54.831104 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-65472951-0a22-4794-9a87-0888c46ac13a tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1809 microversion: 2.20 time: 0.155037 Jun 07 22:09:54.831713 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 444/884] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:09:54 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 22:09:54.957337 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-30dc92af-5e08-45c4-9bed-5190309442a8 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:09:54.957925 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-30dc92af-5e08-45c4-9bed-5190309442a8 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:09:54.964034 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-30dc92af-5e08-45c4-9bed-5190309442a8 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:54.964478 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-30dc92af-5e08-45c4-9bed-5190309442a8 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:54.965530 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-30dc92af-5e08-45c4-9bed-5190309442a8 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:54.965963 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-30dc92af-5e08-45c4-9bed-5190309442a8 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:55.049300 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.objects.instance [None req-30dc92af-5e08-45c4-9bed-5190309442a8 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lazy-loading 'services' on Instance uuid f29be694-507c-48eb-9fdd-d20bef8f6609 {{(pid=117970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 22:09:55.128066 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-30dc92af-5e08-45c4-9bed-5190309442a8 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609/os-volume_attachments/9cbda081-f6ed-4cf9-858e-683a99628f57" status: 202 len: 0 microversion: 2.1 time: 0.174585 Jun 07 22:09:55.128652 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 441/885] 10.222.0.13 () {58 vars in 1415 bytes} [Tue Jun 7 22:09:54 2022] DELETE /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609/os-volume_attachments/9cbda081-f6ed-4cf9-858e-683a99628f57 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 22:09:55.394853 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-9daa6033-394d-4855-b4ee-bf81c4ddf1be tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:09:55.395882 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-9daa6033-394d-4855-b4ee-bf81c4ddf1be tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: f84b4686-8e5c-49af-b5ad-13f37e20f976] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:09:55.402000 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-9daa6033-394d-4855-b4ee-bf81c4ddf1be tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:55.403008 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-9daa6033-394d-4855-b4ee-bf81c4ddf1be tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:55.403830 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-9daa6033-394d-4855-b4ee-bf81c4ddf1be tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:55.404266 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-9daa6033-394d-4855-b4ee-bf81c4ddf1be tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:55.426580 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.objects.instance [None req-9daa6033-394d-4855-b4ee-bf81c4ddf1be tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lazy-loading 'flavor' on Instance uuid f84b4686-8e5c-49af-b5ad-13f37e20f976 {{(pid=117971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 22:09:55.544180 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-9daa6033-394d-4855-b4ee-bf81c4ddf1be tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "POST /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976/action" status: 200 len: 32 microversion: 2.1 time: 0.153248 Jun 07 22:09:55.544780 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 445/886] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Jun 7 22:09:55 2022] POST /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976/action => generated 32 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 07 22:09:55.556882 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-9ea60fa6-7da2-419e-97b9-5b018f8f7be3 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:09:55.557576 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-9ea60fa6-7da2-419e-97b9-5b018f8f7be3 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: f84b4686-8e5c-49af-b5ad-13f37e20f976] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:09:55.566049 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-9ea60fa6-7da2-419e-97b9-5b018f8f7be3 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:55.566782 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-9ea60fa6-7da2-419e-97b9-5b018f8f7be3 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:55.568165 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-9ea60fa6-7da2-419e-97b9-5b018f8f7be3 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:55.568840 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-9ea60fa6-7da2-419e-97b9-5b018f8f7be3 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:55.702738 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-9ea60fa6-7da2-419e-97b9-5b018f8f7be3 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:55.710825 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-9ea60fa6-7da2-419e-97b9-5b018f8f7be3 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976" status: 200 len: 1735 microversion: 2.1 time: 0.159243 Jun 07 22:09:55.711434 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 442/887] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:09:55 2022] GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:09:55.764298 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-34dd805b-71bd-4f85-8451-403d9f2079eb tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:09:55.765016 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-34dd805b-71bd-4f85-8451-403d9f2079eb tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:09:55.771280 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-34dd805b-71bd-4f85-8451-403d9f2079eb tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:55.771754 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-34dd805b-71bd-4f85-8451-403d9f2079eb tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:55.772511 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-34dd805b-71bd-4f85-8451-403d9f2079eb tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:55.772945 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-34dd805b-71bd-4f85-8451-403d9f2079eb tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:55.850143 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-97d2533f-0883-4e5e-a46e-3041289b22f5 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:09:55.850982 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-97d2533f-0883-4e5e-a46e-3041289b22f5 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:09:55.857992 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-97d2533f-0883-4e5e-a46e-3041289b22f5 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:55.858435 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-97d2533f-0883-4e5e-a46e-3041289b22f5 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:55.859187 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-97d2533f-0883-4e5e-a46e-3041289b22f5 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:55.859667 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-97d2533f-0883-4e5e-a46e-3041289b22f5 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:55.927193 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-34dd805b-71bd-4f85-8451-403d9f2079eb tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af02cd6ffd0484c8f6569629cd6313c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31cd38d46643fbac516d21ee4f89ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:55.937246 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-34dd805b-71bd-4f85-8451-403d9f2079eb tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b" status: 200 len: 1753 microversion: 2.1 time: 0.178152 Jun 07 22:09:55.937837 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 446/888] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:09:55 2022] GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b => generated 1753 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:09:56.083355 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-97d2533f-0883-4e5e-a46e-3041289b22f5 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:56.093348 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-97d2533f-0883-4e5e-a46e-3041289b22f5 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:56.095078 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-97d2533f-0883-4e5e-a46e-3041289b22f5 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:56.096429 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-97d2533f-0883-4e5e-a46e-3041289b22f5 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1809 microversion: 2.20 time: 0.250336 Jun 07 22:09:56.097299 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 443/889] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:09:55 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1809 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:09:56.729159 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-ac0a5c7d-89f1-4a49-95d9-0a2660206043 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:09:56.729688 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-ac0a5c7d-89f1-4a49-95d9-0a2660206043 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: f84b4686-8e5c-49af-b5ad-13f37e20f976] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:09:56.736372 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ac0a5c7d-89f1-4a49-95d9-0a2660206043 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:56.736819 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ac0a5c7d-89f1-4a49-95d9-0a2660206043 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:56.737576 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ac0a5c7d-89f1-4a49-95d9-0a2660206043 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:56.738011 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ac0a5c7d-89f1-4a49-95d9-0a2660206043 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:56.866503 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-ac0a5c7d-89f1-4a49-95d9-0a2660206043 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:56.875249 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-ac0a5c7d-89f1-4a49-95d9-0a2660206043 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976" status: 200 len: 1735 microversion: 2.1 time: 0.150305 Jun 07 22:09:56.875849 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 447/890] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:09:56 2022] GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:09:56.954623 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-6c2dc781-7683-493e-b40c-26dca7946310 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:09:56.955920 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-6c2dc781-7683-493e-b40c-26dca7946310 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:09:56.962627 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6c2dc781-7683-493e-b40c-26dca7946310 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:56.963130 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6c2dc781-7683-493e-b40c-26dca7946310 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:56.964018 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6c2dc781-7683-493e-b40c-26dca7946310 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:56.964476 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6c2dc781-7683-493e-b40c-26dca7946310 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:56.977605 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [req-2e0f0771-9a6c-4b69-a94d-2524d9dc303c req-3a051859-d505-4f86-a732-810f4a0a8fa7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07abb105-095a-47ad-8761-b5075254ac95", "name": "network-vif-plugged", "status": "completed", "tag": "dfed4201-3c81-4b15-b164-8dd355eaca62"}]} {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:09:56.987144 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-2e0f0771-9a6c-4b69-a94d-2524d9dc303c req-3a051859-d505-4f86-a732-810f4a0a8fa7 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:56.987617 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-2e0f0771-9a6c-4b69-a94d-2524d9dc303c req-3a051859-d505-4f86-a732-810f4a0a8fa7 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:57.001223 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.compute.server_external_events [req-2e0f0771-9a6c-4b69-a94d-2524d9dc303c req-3a051859-d505-4f86-a732-810f4a0a8fa7 service nova] Creating event network-vif-plugged:dfed4201-3c81-4b15-b164-8dd355eaca62 for instance 07abb105-095a-47ad-8761-b5075254ac95 on hv-cinder-83552 Jun 07 22:09:57.006231 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [req-2e0f0771-9a6c-4b69-a94d-2524d9dc303c req-3a051859-d505-4f86-a732-810f4a0a8fa7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032561 Jun 07 22:09:57.006935 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 448/891] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:09:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 22:09:57.116043 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-d94fa9d0-6de8-4f97-b25b-3a744e005e55 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:09:57.116769 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-d94fa9d0-6de8-4f97-b25b-3a744e005e55 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:09:57.119864 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-6c2dc781-7683-493e-b40c-26dca7946310 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af02cd6ffd0484c8f6569629cd6313c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31cd38d46643fbac516d21ee4f89ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:57.123140 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-d94fa9d0-6de8-4f97-b25b-3a744e005e55 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:57.123644 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-d94fa9d0-6de8-4f97-b25b-3a744e005e55 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:57.124411 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-d94fa9d0-6de8-4f97-b25b-3a744e005e55 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:57.124852 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-d94fa9d0-6de8-4f97-b25b-3a744e005e55 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:57.128158 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-6c2dc781-7683-493e-b40c-26dca7946310 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b" status: 200 len: 1753 microversion: 2.1 time: 0.177427 Jun 07 22:09:57.128726 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 444/892] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:09:56 2022] GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b => generated 1753 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:09:57.252004 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-d94fa9d0-6de8-4f97-b25b-3a744e005e55 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:57.260488 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-d94fa9d0-6de8-4f97-b25b-3a744e005e55 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:57.262530 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-d94fa9d0-6de8-4f97-b25b-3a744e005e55 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:57.263864 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-d94fa9d0-6de8-4f97-b25b-3a744e005e55 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1809 microversion: 2.20 time: 0.152225 Jun 07 22:09:57.264425 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 449/893] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:09:57 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 22:09:57.305655 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-82d37cdc-c150-4141-b431-dc572ecfd2b8 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:09:57.311862 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-82d37cdc-c150-4141-b431-dc572ecfd2b8 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:57.312314 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-82d37cdc-c150-4141-b431-dc572ecfd2b8 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:57.334751 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-82d37cdc-c150-4141-b431-dc572ecfd2b8 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Going to try to stop instance {{(pid=117970) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 07 22:09:57.375770 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-82d37cdc-c150-4141-b431-dc572ecfd2b8 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "POST /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609/action" status: 202 len: 0 microversion: 2.1 time: 0.073777 Jun 07 22:09:57.376362 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 445/894] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Jun 7 22:09:57 2022] POST /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 22:09:57.384512 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-29a1a337-05cd-4ec7-81c3-e867a07f6c45 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:09:57.385127 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-29a1a337-05cd-4ec7-81c3-e867a07f6c45 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:09:57.391802 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-29a1a337-05cd-4ec7-81c3-e867a07f6c45 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:57.392249 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-29a1a337-05cd-4ec7-81c3-e867a07f6c45 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:57.393055 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-29a1a337-05cd-4ec7-81c3-e867a07f6c45 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:57.393541 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-29a1a337-05cd-4ec7-81c3-e867a07f6c45 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:57.526415 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-29a1a337-05cd-4ec7-81c3-e867a07f6c45 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:57.534735 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-29a1a337-05cd-4ec7-81c3-e867a07f6c45 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1674 microversion: 2.1 time: 0.154127 Jun 07 22:09:57.535293 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 450/895] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:09:57 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:09:57.893484 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-2724b3d9-bc80-428d-bb93-824be313304f tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:09:57.894217 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-2724b3d9-bc80-428d-bb93-824be313304f tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: f84b4686-8e5c-49af-b5ad-13f37e20f976] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:09:57.900660 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-2724b3d9-bc80-428d-bb93-824be313304f tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:57.901150 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-2724b3d9-bc80-428d-bb93-824be313304f tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:57.901878 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-2724b3d9-bc80-428d-bb93-824be313304f tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:57.902568 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-2724b3d9-bc80-428d-bb93-824be313304f tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:58.036068 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-2724b3d9-bc80-428d-bb93-824be313304f tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:58.045060 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-2724b3d9-bc80-428d-bb93-824be313304f tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976" status: 200 len: 1735 microversion: 2.1 time: 0.155907 Jun 07 22:09:58.045633 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 446/896] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:09:57 2022] GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:09:58.145438 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-9f6eb43c-27a6-47d1-9b6b-1151b45e9b52 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:09:58.145973 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-9f6eb43c-27a6-47d1-9b6b-1151b45e9b52 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:09:58.148385 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_api:SELECT=42 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:09:58.154140 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-9f6eb43c-27a6-47d1-9b6b-1151b45e9b52 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:58.154590 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-9f6eb43c-27a6-47d1-9b6b-1151b45e9b52 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:58.155378 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-9f6eb43c-27a6-47d1-9b6b-1151b45e9b52 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:58.155819 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-9f6eb43c-27a6-47d1-9b6b-1151b45e9b52 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:58.158840 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:09:58.283480 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-364e6a05-f1b3-4ae9-9cd6-f94320830581 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:09:58.284089 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-364e6a05-f1b3-4ae9-9cd6-f94320830581 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:09:58.290004 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-364e6a05-f1b3-4ae9-9cd6-f94320830581 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:58.290452 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-364e6a05-f1b3-4ae9-9cd6-f94320830581 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:58.291231 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-364e6a05-f1b3-4ae9-9cd6-f94320830581 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:58.291689 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-364e6a05-f1b3-4ae9-9cd6-f94320830581 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:58.298281 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-9f6eb43c-27a6-47d1-9b6b-1151b45e9b52 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af02cd6ffd0484c8f6569629cd6313c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31cd38d46643fbac516d21ee4f89ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:58.306257 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-9f6eb43c-27a6-47d1-9b6b-1151b45e9b52 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b" status: 200 len: 1753 microversion: 2.1 time: 0.164735 Jun 07 22:09:58.306830 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 451/897] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:09:58 2022] GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b => generated 1753 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:09:58.420574 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-364e6a05-f1b3-4ae9-9cd6-f94320830581 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:58.422888 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:09:58.430579 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-364e6a05-f1b3-4ae9-9cd6-f94320830581 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:58.432106 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-364e6a05-f1b3-4ae9-9cd6-f94320830581 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:58.433317 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-364e6a05-f1b3-4ae9-9cd6-f94320830581 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1809 microversion: 2.20 time: 0.153760 Jun 07 22:09:58.434095 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 447/898] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:09:58 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 22:09:58.551892 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-78521ec3-453d-40f3-bb52-e407284d6a59 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:09:58.552499 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-78521ec3-453d-40f3-bb52-e407284d6a59 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:09:58.558472 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-78521ec3-453d-40f3-bb52-e407284d6a59 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:58.558914 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-78521ec3-453d-40f3-bb52-e407284d6a59 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:58.559681 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-78521ec3-453d-40f3-bb52-e407284d6a59 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:58.560112 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-78521ec3-453d-40f3-bb52-e407284d6a59 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:58.693347 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-78521ec3-453d-40f3-bb52-e407284d6a59 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:58.701807 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-78521ec3-453d-40f3-bb52-e407284d6a59 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1674 microversion: 2.1 time: 0.153764 Jun 07 22:09:58.702377 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 452/899] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:09:58 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:09:59.062792 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-64a3b02b-679e-4a45-847a-6445cc0c0e1c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:09:59.063443 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-64a3b02b-679e-4a45-847a-6445cc0c0e1c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: f84b4686-8e5c-49af-b5ad-13f37e20f976] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:09:59.071082 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-64a3b02b-679e-4a45-847a-6445cc0c0e1c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:59.071566 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-64a3b02b-679e-4a45-847a-6445cc0c0e1c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:59.072327 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-64a3b02b-679e-4a45-847a-6445cc0c0e1c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:59.072768 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-64a3b02b-679e-4a45-847a-6445cc0c0e1c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:59.207280 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-64a3b02b-679e-4a45-847a-6445cc0c0e1c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:59.215346 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-64a3b02b-679e-4a45-847a-6445cc0c0e1c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976" status: 200 len: 1735 microversion: 2.1 time: 0.157204 Jun 07 22:09:59.215907 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 448/900] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:09:59 2022] GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:09:59.323792 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-c1311359-0269-41b6-90a1-a9a7cafcc94e tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:09:59.325153 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-c1311359-0269-41b6-90a1-a9a7cafcc94e tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:09:59.331708 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c1311359-0269-41b6-90a1-a9a7cafcc94e tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:59.332150 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c1311359-0269-41b6-90a1-a9a7cafcc94e tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:59.332893 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c1311359-0269-41b6-90a1-a9a7cafcc94e tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:59.333319 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c1311359-0269-41b6-90a1-a9a7cafcc94e tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:59.452513 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-a1aa5bf6-cc1f-4b48-bfa1-da75a2665704 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:09:59.453132 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-a1aa5bf6-cc1f-4b48-bfa1-da75a2665704 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:09:59.458992 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a1aa5bf6-cc1f-4b48-bfa1-da75a2665704 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:59.459476 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a1aa5bf6-cc1f-4b48-bfa1-da75a2665704 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:59.460231 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a1aa5bf6-cc1f-4b48-bfa1-da75a2665704 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:59.460668 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a1aa5bf6-cc1f-4b48-bfa1-da75a2665704 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:59.472267 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-c1311359-0269-41b6-90a1-a9a7cafcc94e tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af02cd6ffd0484c8f6569629cd6313c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31cd38d46643fbac516d21ee4f89ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:59.480871 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-c1311359-0269-41b6-90a1-a9a7cafcc94e tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b" status: 200 len: 1753 microversion: 2.1 time: 0.160468 Jun 07 22:09:59.481433 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 453/901] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:09:59 2022] GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b => generated 1753 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:09:59.587790 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-a1aa5bf6-cc1f-4b48-bfa1-da75a2665704 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:59.596222 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-a1aa5bf6-cc1f-4b48-bfa1-da75a2665704 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:59.597713 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-a1aa5bf6-cc1f-4b48-bfa1-da75a2665704 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:59.598867 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-a1aa5bf6-cc1f-4b48-bfa1-da75a2665704 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1809 microversion: 2.20 time: 0.151084 Jun 07 22:09:59.599455 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 449/902] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:09:59 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1809 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 22:09:59.719162 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-ed4f9c0c-1524-4686-bfe4-b14b3972edd8 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:09:59.719862 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-ed4f9c0c-1524-4686-bfe4-b14b3972edd8 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:09:59.725744 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ed4f9c0c-1524-4686-bfe4-b14b3972edd8 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:59.726198 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ed4f9c0c-1524-4686-bfe4-b14b3972edd8 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:59.727216 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ed4f9c0c-1524-4686-bfe4-b14b3972edd8 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:09:59.727678 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ed4f9c0c-1524-4686-bfe4-b14b3972edd8 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:09:59.865250 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-ed4f9c0c-1524-4686-bfe4-b14b3972edd8 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:09:59.874202 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-ed4f9c0c-1524-4686-bfe4-b14b3972edd8 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1674 microversion: 2.1 time: 0.158933 Jun 07 22:09:59.874872 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 454/903] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:09:59 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1674 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:10:00.233347 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-6b311b9e-4e92-459b-a825-52f7b6483aeb tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:00.233960 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-6b311b9e-4e92-459b-a825-52f7b6483aeb tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: f84b4686-8e5c-49af-b5ad-13f37e20f976] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:00.240482 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6b311b9e-4e92-459b-a825-52f7b6483aeb tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:00.240955 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6b311b9e-4e92-459b-a825-52f7b6483aeb tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:00.241709 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6b311b9e-4e92-459b-a825-52f7b6483aeb tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:00.242142 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6b311b9e-4e92-459b-a825-52f7b6483aeb tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:00.372125 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-6b311b9e-4e92-459b-a825-52f7b6483aeb tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:10:00.380465 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-6b311b9e-4e92-459b-a825-52f7b6483aeb tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976" status: 200 len: 1735 microversion: 2.1 time: 0.151825 Jun 07 22:10:00.381037 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 450/904] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:10:00 2022] GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:10:00.498172 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-622fc419-6193-43bf-818b-659841f290bc tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:00.498813 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-622fc419-6193-43bf-818b-659841f290bc tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:00.505248 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-622fc419-6193-43bf-818b-659841f290bc tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:00.505689 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-622fc419-6193-43bf-818b-659841f290bc tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:00.506429 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-622fc419-6193-43bf-818b-659841f290bc tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:00.506859 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-622fc419-6193-43bf-818b-659841f290bc tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:00.618434 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-9eec3f3e-0aab-44df-a231-7652444e1e5d tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:00.619084 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-9eec3f3e-0aab-44df-a231-7652444e1e5d tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:00.625970 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-9eec3f3e-0aab-44df-a231-7652444e1e5d tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:00.626972 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-9eec3f3e-0aab-44df-a231-7652444e1e5d tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:00.627849 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-9eec3f3e-0aab-44df-a231-7652444e1e5d tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:00.628366 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-9eec3f3e-0aab-44df-a231-7652444e1e5d tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:00.664937 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-622fc419-6193-43bf-818b-659841f290bc tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af02cd6ffd0484c8f6569629cd6313c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31cd38d46643fbac516d21ee4f89ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:10:00.675244 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-622fc419-6193-43bf-818b-659841f290bc tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b" status: 200 len: 1753 microversion: 2.1 time: 0.181470 Jun 07 22:10:00.676121 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 455/905] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:10:00 2022] GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b => generated 1753 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:10:00.770824 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-9eec3f3e-0aab-44df-a231-7652444e1e5d tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:10:00.780324 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-9eec3f3e-0aab-44df-a231-7652444e1e5d tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:10:00.781802 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-9eec3f3e-0aab-44df-a231-7652444e1e5d tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:10:00.782958 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-9eec3f3e-0aab-44df-a231-7652444e1e5d tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1796 microversion: 2.20 time: 0.169100 Jun 07 22:10:00.783545 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 451/906] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:10:00 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1796 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 22:10:00.893457 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-9669158d-fe07-45fa-896a-dcce3d6c240d tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:00.893984 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-9669158d-fe07-45fa-896a-dcce3d6c240d tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:00.900865 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-9669158d-fe07-45fa-896a-dcce3d6c240d tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:00.901311 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-9669158d-fe07-45fa-896a-dcce3d6c240d tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:00.902224 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-9669158d-fe07-45fa-896a-dcce3d6c240d tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:00.902675 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-9669158d-fe07-45fa-896a-dcce3d6c240d tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:01.056903 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-9669158d-fe07-45fa-896a-dcce3d6c240d tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:10:01.065280 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-9669158d-fe07-45fa-896a-dcce3d6c240d tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1674 microversion: 2.1 time: 0.175733 Jun 07 22:10:01.065863 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 456/907] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:10:00 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1674 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:10:01.399000 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-8e609a17-8268-49b1-bf60-f4be94e1e135 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:01.399714 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-8e609a17-8268-49b1-bf60-f4be94e1e135 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: f84b4686-8e5c-49af-b5ad-13f37e20f976] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:01.408076 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-8e609a17-8268-49b1-bf60-f4be94e1e135 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:01.408618 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-8e609a17-8268-49b1-bf60-f4be94e1e135 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:01.409715 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-8e609a17-8268-49b1-bf60-f4be94e1e135 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:01.410430 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-8e609a17-8268-49b1-bf60-f4be94e1e135 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:01.543894 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-8e609a17-8268-49b1-bf60-f4be94e1e135 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:10:01.551802 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-8e609a17-8268-49b1-bf60-f4be94e1e135 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976" status: 200 len: 1735 microversion: 2.1 time: 0.157595 Jun 07 22:10:01.552368 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 452/908] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:10:01 2022] GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:10:01.696138 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-b044daaf-4e71-417f-91d9-01c2761e4b04 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:01.696673 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-b044daaf-4e71-417f-91d9-01c2761e4b04 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:01.703382 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b044daaf-4e71-417f-91d9-01c2761e4b04 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:01.703833 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b044daaf-4e71-417f-91d9-01c2761e4b04 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:01.704592 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b044daaf-4e71-417f-91d9-01c2761e4b04 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:01.705026 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b044daaf-4e71-417f-91d9-01c2761e4b04 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:01.850311 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-b044daaf-4e71-417f-91d9-01c2761e4b04 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af02cd6ffd0484c8f6569629cd6313c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31cd38d46643fbac516d21ee4f89ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:10:01.858734 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-b044daaf-4e71-417f-91d9-01c2761e4b04 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b" status: 200 len: 1756 microversion: 2.1 time: 0.166579 Jun 07 22:10:01.859294 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 457/909] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:10:01 2022] GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:10:02.081851 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-9331d006-3cdc-413a-ad5f-67d76bedcef0 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:02.082457 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-9331d006-3cdc-413a-ad5f-67d76bedcef0 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:02.088461 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-9331d006-3cdc-413a-ad5f-67d76bedcef0 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:02.088907 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-9331d006-3cdc-413a-ad5f-67d76bedcef0 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:02.090399 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-9331d006-3cdc-413a-ad5f-67d76bedcef0 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:02.090845 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-9331d006-3cdc-413a-ad5f-67d76bedcef0 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:02.229055 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-9331d006-3cdc-413a-ad5f-67d76bedcef0 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:10:02.236755 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-9331d006-3cdc-413a-ad5f-67d76bedcef0 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1674 microversion: 2.1 time: 0.158749 Jun 07 22:10:02.237323 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 453/910] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:10:02 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1674 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:10:02.567973 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-934bb864-e17d-4ae5-b492-d2fbbb4dca4f tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:02.568583 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-934bb864-e17d-4ae5-b492-d2fbbb4dca4f tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: f84b4686-8e5c-49af-b5ad-13f37e20f976] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:02.574721 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-934bb864-e17d-4ae5-b492-d2fbbb4dca4f tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:02.575199 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-934bb864-e17d-4ae5-b492-d2fbbb4dca4f tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:02.575983 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-934bb864-e17d-4ae5-b492-d2fbbb4dca4f tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:02.576419 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-934bb864-e17d-4ae5-b492-d2fbbb4dca4f tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:02.702539 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-934bb864-e17d-4ae5-b492-d2fbbb4dca4f tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:10:02.710728 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-934bb864-e17d-4ae5-b492-d2fbbb4dca4f tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976" status: 200 len: 1735 microversion: 2.1 time: 0.146689 Jun 07 22:10:02.711348 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 458/911] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:10:02 2022] GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:10:03.254183 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-aff2f547-c631-4dca-990c-bac906437c3c tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:03.254792 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-aff2f547-c631-4dca-990c-bac906437c3c tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:03.261872 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-aff2f547-c631-4dca-990c-bac906437c3c tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:03.262364 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-aff2f547-c631-4dca-990c-bac906437c3c tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:03.263186 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-aff2f547-c631-4dca-990c-bac906437c3c tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:03.263652 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-aff2f547-c631-4dca-990c-bac906437c3c tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:03.391836 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-aff2f547-c631-4dca-990c-bac906437c3c tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:10:03.399220 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-aff2f547-c631-4dca-990c-bac906437c3c tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1674 microversion: 2.1 time: 0.149183 Jun 07 22:10:03.399959 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 454/912] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:10:03 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1674 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:10:03.727765 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-50968769-af5c-4e4b-9c2e-0094653ab883 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:03.728390 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-50968769-af5c-4e4b-9c2e-0094653ab883 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: f84b4686-8e5c-49af-b5ad-13f37e20f976] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:03.735008 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-50968769-af5c-4e4b-9c2e-0094653ab883 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:03.735485 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-50968769-af5c-4e4b-9c2e-0094653ab883 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:03.736238 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-50968769-af5c-4e4b-9c2e-0094653ab883 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:03.736668 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-50968769-af5c-4e4b-9c2e-0094653ab883 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:03.865522 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-50968769-af5c-4e4b-9c2e-0094653ab883 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:10:03.874028 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-50968769-af5c-4e4b-9c2e-0094653ab883 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976" status: 200 len: 1735 microversion: 2.1 time: 0.150473 Jun 07 22:10:03.874580 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 459/913] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:10:03 2022] GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:10:04.417170 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-4b8d3f5f-90c9-4941-b1f8-cb611d396d28 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:04.418347 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-4b8d3f5f-90c9-4941-b1f8-cb611d396d28 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:04.424798 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4b8d3f5f-90c9-4941-b1f8-cb611d396d28 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:04.425253 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4b8d3f5f-90c9-4941-b1f8-cb611d396d28 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:04.426011 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4b8d3f5f-90c9-4941-b1f8-cb611d396d28 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:04.426452 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4b8d3f5f-90c9-4941-b1f8-cb611d396d28 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:04.552336 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-4b8d3f5f-90c9-4941-b1f8-cb611d396d28 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:10:04.559738 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-4b8d3f5f-90c9-4941-b1f8-cb611d396d28 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1674 microversion: 2.1 time: 0.146532 Jun 07 22:10:04.560406 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 455/914] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:10:04 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1674 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:10:04.890739 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-111f2af5-8d39-47b4-bf81-0f079611ba80 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:04.891369 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-111f2af5-8d39-47b4-bf81-0f079611ba80 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: f84b4686-8e5c-49af-b5ad-13f37e20f976] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:04.897840 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-111f2af5-8d39-47b4-bf81-0f079611ba80 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:04.898283 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-111f2af5-8d39-47b4-bf81-0f079611ba80 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:04.899036 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-111f2af5-8d39-47b4-bf81-0f079611ba80 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:04.899513 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-111f2af5-8d39-47b4-bf81-0f079611ba80 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:05.031647 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-111f2af5-8d39-47b4-bf81-0f079611ba80 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:10:05.039533 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-111f2af5-8d39-47b4-bf81-0f079611ba80 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976" status: 200 len: 1735 microversion: 2.1 time: 0.153271 Jun 07 22:10:05.040093 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 460/915] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:10:04 2022] GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:10:05.577068 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-4c0b848d-12fc-4173-b71c-22d2d815fa9e tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:05.577673 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-4c0b848d-12fc-4173-b71c-22d2d815fa9e tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:05.584735 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4c0b848d-12fc-4173-b71c-22d2d815fa9e tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:05.585183 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4c0b848d-12fc-4173-b71c-22d2d815fa9e tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:05.585966 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4c0b848d-12fc-4173-b71c-22d2d815fa9e tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:05.586400 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4c0b848d-12fc-4173-b71c-22d2d815fa9e tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:05.715883 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-4c0b848d-12fc-4173-b71c-22d2d815fa9e tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:10:05.723267 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-4c0b848d-12fc-4173-b71c-22d2d815fa9e tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1674 microversion: 2.1 time: 0.150267 Jun 07 22:10:05.723860 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 456/916] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:10:05 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1674 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:10:06.057099 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-9b28d53b-2d0a-4e56-8213-edc848f65e0b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:06.057761 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-9b28d53b-2d0a-4e56-8213-edc848f65e0b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: f84b4686-8e5c-49af-b5ad-13f37e20f976] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:06.064720 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-9b28d53b-2d0a-4e56-8213-edc848f65e0b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:06.065169 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-9b28d53b-2d0a-4e56-8213-edc848f65e0b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:06.065957 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-9b28d53b-2d0a-4e56-8213-edc848f65e0b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:06.066395 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-9b28d53b-2d0a-4e56-8213-edc848f65e0b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:06.194674 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-9b28d53b-2d0a-4e56-8213-edc848f65e0b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:10:06.202979 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-9b28d53b-2d0a-4e56-8213-edc848f65e0b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976" status: 200 len: 1735 microversion: 2.1 time: 0.149831 Jun 07 22:10:06.203576 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 461/917] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:10:06 2022] GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:10:06.740554 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-304d71e0-b6b2-4c33-99b0-c33e5a97289b tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:06.741157 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-304d71e0-b6b2-4c33-99b0-c33e5a97289b tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:06.748438 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-304d71e0-b6b2-4c33-99b0-c33e5a97289b tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:06.748909 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-304d71e0-b6b2-4c33-99b0-c33e5a97289b tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:06.749659 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-304d71e0-b6b2-4c33-99b0-c33e5a97289b tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:06.750089 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-304d71e0-b6b2-4c33-99b0-c33e5a97289b tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:06.878540 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-304d71e0-b6b2-4c33-99b0-c33e5a97289b tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:10:06.885912 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-304d71e0-b6b2-4c33-99b0-c33e5a97289b tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1674 microversion: 2.1 time: 0.149298 Jun 07 22:10:06.895952 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 457/918] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:10:06 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1674 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:10:07.220550 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-daaa2d48-7e71-4509-92a3-2667c3ee70ae tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:07.221713 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-daaa2d48-7e71-4509-92a3-2667c3ee70ae tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: f84b4686-8e5c-49af-b5ad-13f37e20f976] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:07.229445 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-daaa2d48-7e71-4509-92a3-2667c3ee70ae tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:07.230756 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-daaa2d48-7e71-4509-92a3-2667c3ee70ae tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:07.232199 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-daaa2d48-7e71-4509-92a3-2667c3ee70ae tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:07.232866 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-daaa2d48-7e71-4509-92a3-2667c3ee70ae tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:07.375005 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-daaa2d48-7e71-4509-92a3-2667c3ee70ae tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:10:07.382838 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-daaa2d48-7e71-4509-92a3-2667c3ee70ae tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976" status: 200 len: 1735 microversion: 2.1 time: 0.166501 Jun 07 22:10:07.383424 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 462/919] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:10:07 2022] GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:10:07.706658 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-f770831f-73bc-42ae-899c-5bcad5141f26 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:07.707160 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-f770831f-73bc-42ae-899c-5bcad5141f26 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 53059fb5-bea1-4713-94dd-fb6cd8841fe9] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:07.713095 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f770831f-73bc-42ae-899c-5bcad5141f26 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:07.713543 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f770831f-73bc-42ae-899c-5bcad5141f26 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:07.714854 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f770831f-73bc-42ae-899c-5bcad5141f26 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:07.715284 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f770831f-73bc-42ae-899c-5bcad5141f26 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:07.738350 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-f770831f-73bc-42ae-899c-5bcad5141f26 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/53059fb5-bea1-4713-94dd-fb6cd8841fe9/ips" status: 200 len: 151 microversion: 2.1 time: 0.137368 Jun 07 22:10:07.738848 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 458/920] 10.222.0.13 () {58 vars in 1247 bytes} [Tue Jun 7 22:10:07 2022] GET /compute/v2.1/servers/53059fb5-bea1-4713-94dd-fb6cd8841fe9/ips => generated 151 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:10:07.750531 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-ac7bd345-affc-49cc-b386-e18392c6ad6f tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "027d8286-c9fc-451b-a66d-1737c3852496"}} {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:10:07.751762 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-ac7bd345-affc-49cc-b386-e18392c6ad6f tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 53059fb5-bea1-4713-94dd-fb6cd8841fe9] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:07.757957 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ac7bd345-affc-49cc-b386-e18392c6ad6f tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:07.758489 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ac7bd345-affc-49cc-b386-e18392c6ad6f tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:07.759459 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ac7bd345-affc-49cc-b386-e18392c6ad6f tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:07.759793 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ac7bd345-affc-49cc-b386-e18392c6ad6f tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:07.840920 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.wsgi [None req-ac7bd345-affc-49cc-b386-e18392c6ad6f tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] HTTP exception thrown: Invalid volume: volume 027d8286-c9fc-451b-a66d-1737c3852496 is already attached to instances: 5704eeef-7ef8-4e6d-b39d-d672e9592836 Jun 07 22:10:07.842652 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-ac7bd345-affc-49cc-b386-e18392c6ad6f tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Request method failure captured: Jun 07 22:10:07.842652 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: request: POST /compute/v2.1/servers/53059fb5-bea1-4713-94dd-fb6cd8841fe9/os-volume_attachments HTTP/1.1 Jun 07 22:10:07.842652 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Accept: application/json Jun 07 22:10:07.842652 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Accept-Encoding: identity Jun 07 22:10:07.842652 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Connection: close Jun 07 22:10:07.842652 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Content-Length: 74 Jun 07 22:10:07.842652 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Content-Type: application/json Jun 07 22:10:07.842652 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Host: 10.222.0.13 Jun 07 22:10:07.842652 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Openstack-System-Scope: None Jun 07 22:10:07.842652 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: User-Agent: python-urllib3/1.26.9 Jun 07 22:10:07.842652 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Auth-Token: gAAAAABin8srQLbStzUvCeAnRNadMyGlcKFPPrFg9QuKcDpjIyywTcK8viTuRoYw24qPuVh7wMg6UWBPhX8hggkc6BZRBiLlvXhF5-X03MFchuLsFFC__9JBLL5O-wkDCN77ZFc33WSFPA37h4CwlIMlU5FumSkwBM-s6ELIPTrdhu_0TKT1s2Y Jun 07 22:10:07.842652 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Domain-Id: None Jun 07 22:10:07.842652 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Domain-Name: None Jun 07 22:10:07.842652 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Identity-Status: Confirmed Jun 07 22:10:07.842652 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Is-Admin-Project: True Jun 07 22:10:07.842652 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Domain-Id: default Jun 07 22:10:07.842652 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Domain-Name: Default Jun 07 22:10:07.842652 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Id: 49d73c22e28a450a99d0952aa686dccf Jun 07 22:10:07.842652 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Name: tempest-AttachVolumeNegativeTest-1740363357 Jun 07 22:10:07.842652 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Role: member,reader Jun 07 22:10:07.842652 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Roles: member,reader Jun 07 22:10:07.844116 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/49d73c22e28a450a99d0952aa686dccf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_49d73c22e28a450a99d0952aa686dccf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/49d73c22e28a450a99d0952aa686dccf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/49d73c22e28a450a99d0952aa686dccf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}] Jun 07 22:10:07.844116 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant: tempest-AttachVolumeNegativeTest-1740363357 Jun 07 22:10:07.844116 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant-Id: 49d73c22e28a450a99d0952aa686dccf Jun 07 22:10:07.844116 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1740363357 Jun 07 22:10:07.844116 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User: tempest-AttachVolumeNegativeTest-1740363357-project Jun 07 22:10:07.844116 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Domain-Id: default Jun 07 22:10:07.844116 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Domain-Name: Default Jun 07 22:10:07.844116 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Id: 607b70b4d6e14c95ae2880dd3577c8ae Jun 07 22:10:07.844116 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Name: tempest-AttachVolumeNegativeTest-1740363357-project Jun 07 22:10:07.844116 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Jun 07 22:10:07.844116 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: {"volumeAttachment": {"volumeId": "027d8286-c9fc-451b-a66d-1737c3852496"}} Jun 07 22:10:07.844116 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: method: > Jun 07 22:10:07.844892 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: exception: Invalid volume: volume 027d8286-c9fc-451b-a66d-1737c3852496 is already attached to instances: 5704eeef-7ef8-4e6d-b39d-d672e9592836 Jun 07 22:10:07.844892 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: action_args: {'server_id': '53059fb5-bea1-4713-94dd-fb6cd8841fe9', 'body': {'volumeAttachment': {'volumeId': '027d8286-c9fc-451b-a66d-1737c3852496'}}} Jun 07 22:10:07.844892 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 22:10:07.844892 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:10:07.844892 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 07 22:10:07.844892 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 07 22:10:07.844892 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 07 22:10:07.844892 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 07 22:10:07.844892 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 07 22:10:07.844892 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 07 22:10:07.844892 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 07 22:10:07.844892 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 07 22:10:07.844892 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 07 22:10:07.844892 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 07 22:10:07.844892 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 027d8286-c9fc-451b-a66d-1737c3852496 is already attached to instances: 5704eeef-7ef8-4e6d-b39d-d672e9592836 Jun 07 22:10:07.844892 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:10:07.844892 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:10:07.844892 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:10:07.844892 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:10:07.846064 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:10:07.846064 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:10:07.846064 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 22:10:07.846064 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 22:10:07.846064 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 22:10:07.846064 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 22:10:07.846064 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 07 22:10:07.846064 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 22:10:07.846064 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 07 22:10:07.846064 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 22:10:07.846064 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 07 22:10:07.846064 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 22:10:07.846064 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 07 22:10:07.846064 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 07 22:10:07.846064 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 027d8286-c9fc-451b-a66d-1737c3852496 is already attached to instances: 5704eeef-7ef8-4e6d-b39d-d672e9592836 Jun 07 22:10:07.846064 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:10:07.846064 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:10:07.846064 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:10:07.846064 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:10:07.846064 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:10:07.847256 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:10:07.847256 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 22:10:07.847256 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 22:10:07.847256 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 027d8286-c9fc-451b-a66d-1737c3852496 is already attached to instances: 5704eeef-7ef8-4e6d-b39d-d672e9592836 Jun 07 22:10:07.847256 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:10:07.847256 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-ac7bd345-affc-49cc-b386-e18392c6ad6f tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Returning 400 to user: Invalid volume: volume 027d8286-c9fc-451b-a66d-1737c3852496 is already attached to instances: 5704eeef-7ef8-4e6d-b39d-d672e9592836 {{(pid=117971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 22:10:07.847256 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-ac7bd345-affc-49cc-b386-e18392c6ad6f tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "POST /compute/v2.1/servers/53059fb5-bea1-4713-94dd-fb6cd8841fe9/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097664 Jun 07 22:10:07.847256 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 463/921] 10.222.0.13 () {60 vars in 1322 bytes} [Tue Jun 7 22:10:07 2022] POST /compute/v2.1/servers/53059fb5-bea1-4713-94dd-fb6cd8841fe9/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 07 22:10:07.853945 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-653a86e5-e765-47d5-894b-a32a15a627e0 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:07.854478 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-653a86e5-e765-47d5-894b-a32a15a627e0 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 53059fb5-bea1-4713-94dd-fb6cd8841fe9] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:07.861366 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-653a86e5-e765-47d5-894b-a32a15a627e0 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:07.861737 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-653a86e5-e765-47d5-894b-a32a15a627e0 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:07.862574 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-653a86e5-e765-47d5-894b-a32a15a627e0 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:07.863007 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-653a86e5-e765-47d5-894b-a32a15a627e0 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:07.888494 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-653a86e5-e765-47d5-894b-a32a15a627e0 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 53059fb5-bea1-4713-94dd-fb6cd8841fe9] Going to try to terminate instance {{(pid=117970) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 22:10:07.913141 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-224a1e08-db2a-42bd-8d31-7f51366576f1 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:07.913747 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-224a1e08-db2a-42bd-8d31-7f51366576f1 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:07.920873 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-224a1e08-db2a-42bd-8d31-7f51366576f1 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:07.921318 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-224a1e08-db2a-42bd-8d31-7f51366576f1 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:07.922075 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-224a1e08-db2a-42bd-8d31-7f51366576f1 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:07.922511 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-224a1e08-db2a-42bd-8d31-7f51366576f1 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:07.966126 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-653a86e5-e765-47d5-894b-a32a15a627e0 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "DELETE /compute/v2.1/servers/53059fb5-bea1-4713-94dd-fb6cd8841fe9" status: 204 len: 0 microversion: 2.1 time: 0.116418 Jun 07 22:10:07.969843 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 459/922] 10.222.0.13 () {58 vars in 1238 bytes} [Tue Jun 7 22:10:07 2022] DELETE /compute/v2.1/servers/53059fb5-bea1-4713-94dd-fb6cd8841fe9 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 22:10:07.975777 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-be176d84-2c72-4474-9f04-bad590c12b31 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:07.976586 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-be176d84-2c72-4474-9f04-bad590c12b31 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 53059fb5-bea1-4713-94dd-fb6cd8841fe9] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:07.983834 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-be176d84-2c72-4474-9f04-bad590c12b31 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:07.984275 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-be176d84-2c72-4474-9f04-bad590c12b31 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:07.985023 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-be176d84-2c72-4474-9f04-bad590c12b31 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:07.985647 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-be176d84-2c72-4474-9f04-bad590c12b31 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:08.059113 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-224a1e08-db2a-42bd-8d31-7f51366576f1 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:10:08.066581 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-224a1e08-db2a-42bd-8d31-7f51366576f1 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1674 microversion: 2.1 time: 0.157300 Jun 07 22:10:08.067387 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 464/923] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:10:07 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:10:08.121525 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-be176d84-2c72-4474-9f04-bad590c12b31 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:10:08.128939 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-be176d84-2c72-4474-9f04-bad590c12b31 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/53059fb5-bea1-4713-94dd-fb6cd8841fe9" status: 200 len: 1683 microversion: 2.1 time: 0.157875 Jun 07 22:10:08.129507 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 460/924] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:10:07 2022] GET /compute/v2.1/servers/53059fb5-bea1-4713-94dd-fb6cd8841fe9 => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:10:08.400111 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-d610cfa7-f3ef-48f4-af03-97196f721583 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:08.400643 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-d610cfa7-f3ef-48f4-af03-97196f721583 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: f84b4686-8e5c-49af-b5ad-13f37e20f976] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:08.407447 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-d610cfa7-f3ef-48f4-af03-97196f721583 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:08.407897 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-d610cfa7-f3ef-48f4-af03-97196f721583 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:08.408651 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-d610cfa7-f3ef-48f4-af03-97196f721583 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:08.409085 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-d610cfa7-f3ef-48f4-af03-97196f721583 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:08.538480 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-d610cfa7-f3ef-48f4-af03-97196f721583 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:10:08.547080 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-d610cfa7-f3ef-48f4-af03-97196f721583 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976" status: 200 len: 1735 microversion: 2.1 time: 0.150896 Jun 07 22:10:08.547673 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 465/925] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:10:08 2022] GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:10:09.084604 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-a5bf09f6-ac27-4ff5-94fd-620b9abca8b9 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:09.085869 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-a5bf09f6-ac27-4ff5-94fd-620b9abca8b9 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:09.093138 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a5bf09f6-ac27-4ff5-94fd-620b9abca8b9 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:09.093590 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a5bf09f6-ac27-4ff5-94fd-620b9abca8b9 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:09.094355 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a5bf09f6-ac27-4ff5-94fd-620b9abca8b9 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:09.094799 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a5bf09f6-ac27-4ff5-94fd-620b9abca8b9 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:09.146247 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-ad2b3434-d7ae-41db-a36a-435bca107350 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:09.146856 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-ad2b3434-d7ae-41db-a36a-435bca107350 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 53059fb5-bea1-4713-94dd-fb6cd8841fe9] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:09.153410 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ad2b3434-d7ae-41db-a36a-435bca107350 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:09.153861 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ad2b3434-d7ae-41db-a36a-435bca107350 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:09.154625 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ad2b3434-d7ae-41db-a36a-435bca107350 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:09.155064 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ad2b3434-d7ae-41db-a36a-435bca107350 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:09.227524 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-a5bf09f6-ac27-4ff5-94fd-620b9abca8b9 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:10:09.235944 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-a5bf09f6-ac27-4ff5-94fd-620b9abca8b9 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1674 microversion: 2.1 time: 0.155182 Jun 07 22:10:09.236516 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 461/926] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:10:09 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:10:09.283516 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-ad2b3434-d7ae-41db-a36a-435bca107350 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:10:09.291092 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-ad2b3434-d7ae-41db-a36a-435bca107350 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/53059fb5-bea1-4713-94dd-fb6cd8841fe9" status: 200 len: 1683 microversion: 2.1 time: 0.148688 Jun 07 22:10:09.291691 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 466/927] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:10:09 2022] GET /compute/v2.1/servers/53059fb5-bea1-4713-94dd-fb6cd8841fe9 => generated 1683 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:10:09.563223 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-eaa47efa-fb92-45c5-b7cf-72aaeb524599 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:09.563860 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-eaa47efa-fb92-45c5-b7cf-72aaeb524599 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: f84b4686-8e5c-49af-b5ad-13f37e20f976] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:09.569783 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-eaa47efa-fb92-45c5-b7cf-72aaeb524599 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:09.570223 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-eaa47efa-fb92-45c5-b7cf-72aaeb524599 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:09.570962 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-eaa47efa-fb92-45c5-b7cf-72aaeb524599 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:09.571436 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-eaa47efa-fb92-45c5-b7cf-72aaeb524599 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:09.702037 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-eaa47efa-fb92-45c5-b7cf-72aaeb524599 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:10:09.709925 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-eaa47efa-fb92-45c5-b7cf-72aaeb524599 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976" status: 200 len: 1735 microversion: 2.1 time: 0.150520 Jun 07 22:10:09.710485 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 462/928] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:10:09 2022] GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:10:10.255454 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-1a18ffd6-6bb0-40d6-86ec-c2ba7b6ed3c7 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:10.256059 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-1a18ffd6-6bb0-40d6-86ec-c2ba7b6ed3c7 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:10.263630 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-1a18ffd6-6bb0-40d6-86ec-c2ba7b6ed3c7 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:10.264078 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-1a18ffd6-6bb0-40d6-86ec-c2ba7b6ed3c7 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:10.264839 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-1a18ffd6-6bb0-40d6-86ec-c2ba7b6ed3c7 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:10.265271 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-1a18ffd6-6bb0-40d6-86ec-c2ba7b6ed3c7 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:10.310543 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-390ef884-9011-48c6-bd87-8689e9d4365a tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:10.311101 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-390ef884-9011-48c6-bd87-8689e9d4365a tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 53059fb5-bea1-4713-94dd-fb6cd8841fe9] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:10.317108 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-390ef884-9011-48c6-bd87-8689e9d4365a tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:10.317549 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-390ef884-9011-48c6-bd87-8689e9d4365a tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:10.318302 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-390ef884-9011-48c6-bd87-8689e9d4365a tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:10.318737 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-390ef884-9011-48c6-bd87-8689e9d4365a tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:10.321477 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:10:10.405389 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-1a18ffd6-6bb0-40d6-86ec-c2ba7b6ed3c7 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:10:10.408787 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_cell1:SELECT=100 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:10:10.413541 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-1a18ffd6-6bb0-40d6-86ec-c2ba7b6ed3c7 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1674 microversion: 2.1 time: 0.163827 Jun 07 22:10:10.414114 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 467/929] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:10:10 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1674 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:10:10.577168 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-390ef884-9011-48c6-bd87-8689e9d4365a tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:10:10.586166 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-390ef884-9011-48c6-bd87-8689e9d4365a tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/53059fb5-bea1-4713-94dd-fb6cd8841fe9" status: 200 len: 1683 microversion: 2.1 time: 0.281184 Jun 07 22:10:10.586779 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 463/930] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:10:10 2022] GET /compute/v2.1/servers/53059fb5-bea1-4713-94dd-fb6cd8841fe9 => generated 1683 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:10:10.727967 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-f81fb63a-59f0-40e1-af11-a5a182531cbd tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:10.728686 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-f81fb63a-59f0-40e1-af11-a5a182531cbd tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: f84b4686-8e5c-49af-b5ad-13f37e20f976] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:10.736426 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-f81fb63a-59f0-40e1-af11-a5a182531cbd tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:10.736950 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-f81fb63a-59f0-40e1-af11-a5a182531cbd tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:10.737777 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-f81fb63a-59f0-40e1-af11-a5a182531cbd tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:10.738279 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-f81fb63a-59f0-40e1-af11-a5a182531cbd tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:10.869770 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-f81fb63a-59f0-40e1-af11-a5a182531cbd tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:10:10.878417 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-f81fb63a-59f0-40e1-af11-a5a182531cbd tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976" status: 200 len: 1735 microversion: 2.1 time: 0.154808 Jun 07 22:10:10.879099 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 468/931] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:10:10 2022] GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:10:11.222388 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [req-0cc6bb5f-feed-4b79-8146-efbe1ff0054b req-2e6687d9-9b9a-4b21-8897-125d8a46b3b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53059fb5-bea1-4713-94dd-fb6cd8841fe9", "name": "network-vif-deleted", "tag": "0b12561e-8139-44a2-93a1-3af2cfa0666e"}]} {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:10:11.240116 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [req-0cc6bb5f-feed-4b79-8146-efbe1ff0054b req-2e6687d9-9b9a-4b21-8897-125d8a46b3b9 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:11.241182 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [req-0cc6bb5f-feed-4b79-8146-efbe1ff0054b req-2e6687d9-9b9a-4b21-8897-125d8a46b3b9 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:11.255417 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.compute.server_external_events [req-0cc6bb5f-feed-4b79-8146-efbe1ff0054b req-2e6687d9-9b9a-4b21-8897-125d8a46b3b9 service nova] Creating event network-vif-deleted:0b12561e-8139-44a2-93a1-3af2cfa0666e for instance 53059fb5-bea1-4713-94dd-fb6cd8841fe9 on hv-cinder-83552 Jun 07 22:10:11.263239 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [req-0cc6bb5f-feed-4b79-8146-efbe1ff0054b req-2e6687d9-9b9a-4b21-8897-125d8a46b3b9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107205 Jun 07 22:10:11.264767 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 464/932] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:10:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:10:11.431992 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-c24c0e7e-0d70-42f4-9440-3b2abeaa1712 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:11.432507 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-c24c0e7e-0d70-42f4-9440-3b2abeaa1712 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:11.439602 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c24c0e7e-0d70-42f4-9440-3b2abeaa1712 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:11.440371 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c24c0e7e-0d70-42f4-9440-3b2abeaa1712 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:11.441236 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c24c0e7e-0d70-42f4-9440-3b2abeaa1712 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:11.441914 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c24c0e7e-0d70-42f4-9440-3b2abeaa1712 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:11.578604 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-c24c0e7e-0d70-42f4-9440-3b2abeaa1712 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:10:11.587817 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-c24c0e7e-0d70-42f4-9440-3b2abeaa1712 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1674 microversion: 2.1 time: 0.159444 Jun 07 22:10:11.597077 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 469/933] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:10:11 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1674 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:10:11.605157 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-319a543a-8fa1-49ae-bc5d-a8ef22aebb20 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:11.606005 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-319a543a-8fa1-49ae-bc5d-a8ef22aebb20 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 53059fb5-bea1-4713-94dd-fb6cd8841fe9] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:11.613155 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-319a543a-8fa1-49ae-bc5d-a8ef22aebb20 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:11.613681 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-319a543a-8fa1-49ae-bc5d-a8ef22aebb20 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:11.614541 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-319a543a-8fa1-49ae-bc5d-a8ef22aebb20 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:11.614981 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-319a543a-8fa1-49ae-bc5d-a8ef22aebb20 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:11.648027 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-319a543a-8fa1-49ae-bc5d-a8ef22aebb20 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:11.648544 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-319a543a-8fa1-49ae-bc5d-a8ef22aebb20 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:11.649007 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.objects.instance [None req-319a543a-8fa1-49ae-bc5d-a8ef22aebb20 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lazy-loading 'fault' on Instance uuid 53059fb5-bea1-4713-94dd-fb6cd8841fe9 {{(pid=117970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 22:10:11.699839 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-319a543a-8fa1-49ae-bc5d-a8ef22aebb20 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:10:11.707355 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-319a543a-8fa1-49ae-bc5d-a8ef22aebb20 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/53059fb5-bea1-4713-94dd-fb6cd8841fe9" status: 200 len: 1331 microversion: 2.1 time: 0.107037 Jun 07 22:10:11.708118 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 465/934] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:10:11 2022] GET /compute/v2.1/servers/53059fb5-bea1-4713-94dd-fb6cd8841fe9 => generated 1331 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:10:11.897811 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-d2873525-8eb6-40ce-9ba2-c6db6d192391 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:11.898399 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-d2873525-8eb6-40ce-9ba2-c6db6d192391 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: f84b4686-8e5c-49af-b5ad-13f37e20f976] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:11.905356 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-d2873525-8eb6-40ce-9ba2-c6db6d192391 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:11.905816 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-d2873525-8eb6-40ce-9ba2-c6db6d192391 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:11.906587 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-d2873525-8eb6-40ce-9ba2-c6db6d192391 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:11.907021 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-d2873525-8eb6-40ce-9ba2-c6db6d192391 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:12.057820 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-d2873525-8eb6-40ce-9ba2-c6db6d192391 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:10:12.067060 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-d2873525-8eb6-40ce-9ba2-c6db6d192391 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976" status: 200 len: 1735 microversion: 2.1 time: 0.174596 Jun 07 22:10:12.077211 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 470/935] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:10:11 2022] GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976 => generated 1735 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:10:12.605485 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-55486e9c-5d02-4235-8720-7e72e3492730 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:12.606089 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-55486e9c-5d02-4235-8720-7e72e3492730 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:12.612292 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-55486e9c-5d02-4235-8720-7e72e3492730 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:12.612735 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-55486e9c-5d02-4235-8720-7e72e3492730 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:12.613485 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-55486e9c-5d02-4235-8720-7e72e3492730 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:12.613913 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-55486e9c-5d02-4235-8720-7e72e3492730 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:12.725423 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-03b40563-bc86-40cc-b6f5-e30316b2b728 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:12.726029 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-03b40563-bc86-40cc-b6f5-e30316b2b728 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 53059fb5-bea1-4713-94dd-fb6cd8841fe9] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:12.734358 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-03b40563-bc86-40cc-b6f5-e30316b2b728 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:12.734887 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-03b40563-bc86-40cc-b6f5-e30316b2b728 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:12.735752 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-03b40563-bc86-40cc-b6f5-e30316b2b728 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:12.736257 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-03b40563-bc86-40cc-b6f5-e30316b2b728 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:12.748547 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-55486e9c-5d02-4235-8720-7e72e3492730 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:10:12.750405 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.wsgi [None req-03b40563-bc86-40cc-b6f5-e30316b2b728 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] HTTP exception thrown: Instance 53059fb5-bea1-4713-94dd-fb6cd8841fe9 could not be found. Jun 07 22:10:12.752075 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-03b40563-bc86-40cc-b6f5-e30316b2b728 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Request method failure captured: Jun 07 22:10:12.752075 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: request: GET /compute/v2.1/servers/53059fb5-bea1-4713-94dd-fb6cd8841fe9 HTTP/1.1 Jun 07 22:10:12.752075 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Accept: application/json Jun 07 22:10:12.752075 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Accept-Encoding: identity Jun 07 22:10:12.752075 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Connection: close Jun 07 22:10:12.752075 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Content-Length: 0 Jun 07 22:10:12.752075 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Content-Type: application/json Jun 07 22:10:12.752075 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Host: 10.222.0.13 Jun 07 22:10:12.752075 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Openstack-System-Scope: None Jun 07 22:10:12.752075 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: User-Agent: python-urllib3/1.26.9 Jun 07 22:10:12.752075 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Auth-Token: gAAAAABin8srQLbStzUvCeAnRNadMyGlcKFPPrFg9QuKcDpjIyywTcK8viTuRoYw24qPuVh7wMg6UWBPhX8hggkc6BZRBiLlvXhF5-X03MFchuLsFFC__9JBLL5O-wkDCN77ZFc33WSFPA37h4CwlIMlU5FumSkwBM-s6ELIPTrdhu_0TKT1s2Y Jun 07 22:10:12.752075 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Domain-Id: None Jun 07 22:10:12.752075 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Domain-Name: None Jun 07 22:10:12.752075 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Identity-Status: Confirmed Jun 07 22:10:12.752075 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Is-Admin-Project: True Jun 07 22:10:12.752075 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Domain-Id: default Jun 07 22:10:12.752075 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Domain-Name: Default Jun 07 22:10:12.752075 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Id: 49d73c22e28a450a99d0952aa686dccf Jun 07 22:10:12.752075 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Name: tempest-AttachVolumeNegativeTest-1740363357 Jun 07 22:10:12.752075 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Role: member,reader Jun 07 22:10:12.752075 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Roles: member,reader Jun 07 22:10:12.753456 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/49d73c22e28a450a99d0952aa686dccf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_49d73c22e28a450a99d0952aa686dccf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/49d73c22e28a450a99d0952aa686dccf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/49d73c22e28a450a99d0952aa686dccf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}] Jun 07 22:10:12.753456 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant: tempest-AttachVolumeNegativeTest-1740363357 Jun 07 22:10:12.753456 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant-Id: 49d73c22e28a450a99d0952aa686dccf Jun 07 22:10:12.753456 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1740363357 Jun 07 22:10:12.753456 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User: tempest-AttachVolumeNegativeTest-1740363357-project Jun 07 22:10:12.753456 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Domain-Id: default Jun 07 22:10:12.753456 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Domain-Name: Default Jun 07 22:10:12.753456 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Id: 607b70b4d6e14c95ae2880dd3577c8ae Jun 07 22:10:12.753456 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Name: tempest-AttachVolumeNegativeTest-1740363357-project Jun 07 22:10:12.753456 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: method: > Jun 07 22:10:12.753456 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: exception: Instance 53059fb5-bea1-4713-94dd-fb6cd8841fe9 could not be found. Jun 07 22:10:12.753456 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: action_args: {'id': '53059fb5-bea1-4713-94dd-fb6cd8841fe9'} Jun 07 22:10:12.754583 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 22:10:12.754583 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:10:12.754583 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 22:10:12.754583 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 22:10:12.754583 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 22:10:12.754583 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 22:10:12.754583 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 22:10:12.754583 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 22:10:12.754583 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 22:10:12.754583 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 22:10:12.754583 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53059fb5-bea1-4713-94dd-fb6cd8841fe9 could not be found. Jun 07 22:10:12.754583 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:10:12.754583 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:10:12.754583 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:10:12.754583 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:10:12.754583 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:10:12.754583 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:10:12.754583 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 22:10:12.754583 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 22:10:12.754583 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 22:10:12.756236 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 22:10:12.756236 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 22:10:12.756236 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 22:10:12.756236 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 22:10:12.756236 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 22:10:12.756236 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 22:10:12.756236 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 22:10:12.756236 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53059fb5-bea1-4713-94dd-fb6cd8841fe9 could not be found. Jun 07 22:10:12.756236 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:10:12.756236 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:10:12.756236 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:10:12.756236 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:10:12.756236 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:10:12.756236 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:10:12.756236 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 22:10:12.756236 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 22:10:12.756236 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53059fb5-bea1-4713-94dd-fb6cd8841fe9 could not be found. Jun 07 22:10:12.756236 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:10:12.757813 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-03b40563-bc86-40cc-b6f5-e30316b2b728 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Returning 404 to user: Instance 53059fb5-bea1-4713-94dd-fb6cd8841fe9 could not be found. {{(pid=117971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 22:10:12.757813 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-03b40563-bc86-40cc-b6f5-e30316b2b728 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/53059fb5-bea1-4713-94dd-fb6cd8841fe9" status: 404 len: 111 microversion: 2.1 time: 0.032019 Jun 07 22:10:12.757813 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 471/936] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:10:12 2022] GET /compute/v2.1/servers/53059fb5-bea1-4713-94dd-fb6cd8841fe9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 22:10:12.759788 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-55486e9c-5d02-4235-8720-7e72e3492730 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1674 microversion: 2.1 time: 0.158881 Jun 07 22:10:12.760352 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 466/937] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:10:12 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1674 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:10:12.765227 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-1f0c8edb-337e-45f8-ac23-f4682b9eccfa tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '.version_select at 0x7f92f1eb11f0>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:12.787203 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-1f0c8edb-337e-45f8-ac23-f4682b9eccfa tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1246217010" status: 202 len: 0 microversion: 2.1 time: 0.028338 Jun 07 22:10:12.787955 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 472/938] 10.222.0.13 () {58 vars in 1220 bytes} [Tue Jun 7 22:10:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1246217010 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 07 22:10:13.085370 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-e46ae899-b7d4-4310-a790-c22d39ac271e tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:13.086152 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-e46ae899-b7d4-4310-a790-c22d39ac271e tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: f84b4686-8e5c-49af-b5ad-13f37e20f976] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:13.093019 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e46ae899-b7d4-4310-a790-c22d39ac271e tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:13.093465 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e46ae899-b7d4-4310-a790-c22d39ac271e tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:13.094228 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e46ae899-b7d4-4310-a790-c22d39ac271e tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:13.094659 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e46ae899-b7d4-4310-a790-c22d39ac271e tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:13.235857 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-e46ae899-b7d4-4310-a790-c22d39ac271e tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:10:13.244578 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-e46ae899-b7d4-4310-a790-c22d39ac271e tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976" status: 200 len: 1735 microversion: 2.1 time: 0.162954 Jun 07 22:10:13.245171 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 467/939] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:10:13 2022] GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:10:13.689782 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-5882e403-b2a5-4bf1-a9a8-f39cc757b6e7 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:13.690292 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-5882e403-b2a5-4bf1-a9a8-f39cc757b6e7 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 5704eeef-7ef8-4e6d-b39d-d672e9592836] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:13.696370 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-5882e403-b2a5-4bf1-a9a8-f39cc757b6e7 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:13.696813 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-5882e403-b2a5-4bf1-a9a8-f39cc757b6e7 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:13.697559 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-5882e403-b2a5-4bf1-a9a8-f39cc757b6e7 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:13.697989 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-5882e403-b2a5-4bf1-a9a8-f39cc757b6e7 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:13.776176 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-0aa7c5be-abd2-420c-9a25-8483a924bd84 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:13.777425 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-0aa7c5be-abd2-420c-9a25-8483a924bd84 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:13.784495 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0aa7c5be-abd2-420c-9a25-8483a924bd84 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:13.784712 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.objects.instance [None req-5882e403-b2a5-4bf1-a9a8-f39cc757b6e7 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lazy-loading 'services' on Instance uuid 5704eeef-7ef8-4e6d-b39d-d672e9592836 {{(pid=117971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 22:10:13.786521 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0aa7c5be-abd2-420c-9a25-8483a924bd84 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:13.787752 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0aa7c5be-abd2-420c-9a25-8483a924bd84 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:13.788441 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0aa7c5be-abd2-420c-9a25-8483a924bd84 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:13.891895 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-5882e403-b2a5-4bf1-a9a8-f39cc757b6e7 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "DELETE /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836/os-volume_attachments/027d8286-c9fc-451b-a66d-1737c3852496" status: 202 len: 0 microversion: 2.1 time: 0.205728 Jun 07 22:10:13.892510 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 473/940] 10.222.0.13 () {58 vars in 1415 bytes} [Tue Jun 7 22:10:13 2022] DELETE /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836/os-volume_attachments/027d8286-c9fc-451b-a66d-1737c3852496 => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 22:10:13.913364 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-4a9ce1f7-fb29-4795-82bb-243ad518de42 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:13.914794 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-4a9ce1f7-fb29-4795-82bb-243ad518de42 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 5704eeef-7ef8-4e6d-b39d-d672e9592836] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:13.922298 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-4a9ce1f7-fb29-4795-82bb-243ad518de42 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:13.922751 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-4a9ce1f7-fb29-4795-82bb-243ad518de42 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:13.923602 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-4a9ce1f7-fb29-4795-82bb-243ad518de42 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:13.924049 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-4a9ce1f7-fb29-4795-82bb-243ad518de42 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:13.959734 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-4a9ce1f7-fb29-4795-82bb-243ad518de42 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058901 Jun 07 22:10:13.960612 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 474/941] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jun 7 22:10:13 2022] GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:10:14.005409 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-0aa7c5be-abd2-420c-9a25-8483a924bd84 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:10:14.016213 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-0aa7c5be-abd2-420c-9a25-8483a924bd84 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1674 microversion: 2.1 time: 0.243713 Jun 07 22:10:14.017711 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 468/942] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:10:13 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1674 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:10:14.262234 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-ea87bb6a-9643-4bc1-a944-464eaf8fe45a tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:14.262778 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-ea87bb6a-9643-4bc1-a944-464eaf8fe45a tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: f84b4686-8e5c-49af-b5ad-13f37e20f976] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:14.268854 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ea87bb6a-9643-4bc1-a944-464eaf8fe45a tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:14.269305 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ea87bb6a-9643-4bc1-a944-464eaf8fe45a tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:14.270065 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ea87bb6a-9643-4bc1-a944-464eaf8fe45a tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:14.270506 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ea87bb6a-9643-4bc1-a944-464eaf8fe45a tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:14.409393 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-ea87bb6a-9643-4bc1-a944-464eaf8fe45a tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:10:14.417907 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-ea87bb6a-9643-4bc1-a944-464eaf8fe45a tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976" status: 200 len: 1735 microversion: 2.1 time: 0.159257 Jun 07 22:10:14.418661 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 475/943] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:10:14 2022] GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:10:14.972419 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-0083cd2b-c062-49bc-976f-8ea5dd713ace tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:14.973271 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-0083cd2b-c062-49bc-976f-8ea5dd713ace tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 5704eeef-7ef8-4e6d-b39d-d672e9592836] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:14.979659 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0083cd2b-c062-49bc-976f-8ea5dd713ace tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:14.980102 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0083cd2b-c062-49bc-976f-8ea5dd713ace tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:14.980858 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0083cd2b-c062-49bc-976f-8ea5dd713ace tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:14.981964 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0083cd2b-c062-49bc-976f-8ea5dd713ace tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:15.016812 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-0083cd2b-c062-49bc-976f-8ea5dd713ace tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048362 Jun 07 22:10:15.017378 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 469/944] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jun 7 22:10:14 2022] GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:10:15.034464 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-1a68eafc-8f4a-4b9d-932c-53720ba8c287 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:15.035077 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-1a68eafc-8f4a-4b9d-932c-53720ba8c287 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:15.041582 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-1a68eafc-8f4a-4b9d-932c-53720ba8c287 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:15.042038 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-1a68eafc-8f4a-4b9d-932c-53720ba8c287 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:15.042802 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-1a68eafc-8f4a-4b9d-932c-53720ba8c287 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:15.043528 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-1a68eafc-8f4a-4b9d-932c-53720ba8c287 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:15.170587 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-1a68eafc-8f4a-4b9d-932c-53720ba8c287 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:10:15.178021 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-1a68eafc-8f4a-4b9d-932c-53720ba8c287 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1674 microversion: 2.1 time: 0.147459 Jun 07 22:10:15.178588 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 476/945] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:10:15 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1674 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:10:15.434612 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-90b17474-e117-437b-b7fa-edac27231d6f tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:15.435531 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-90b17474-e117-437b-b7fa-edac27231d6f tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: f84b4686-8e5c-49af-b5ad-13f37e20f976] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:15.441450 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-90b17474-e117-437b-b7fa-edac27231d6f tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:15.441891 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-90b17474-e117-437b-b7fa-edac27231d6f tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:15.442636 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-90b17474-e117-437b-b7fa-edac27231d6f tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:15.443067 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-90b17474-e117-437b-b7fa-edac27231d6f tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:15.567276 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-90b17474-e117-437b-b7fa-edac27231d6f tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:10:15.575297 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-90b17474-e117-437b-b7fa-edac27231d6f tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976" status: 200 len: 1735 microversion: 2.1 time: 0.145221 Jun 07 22:10:15.575896 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 470/946] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:10:15 2022] GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976 => generated 1735 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:10:16.028642 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-1f58b1b9-9ac1-49cf-8e16-2fb191a98233 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:16.030402 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-1f58b1b9-9ac1-49cf-8e16-2fb191a98233 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 5704eeef-7ef8-4e6d-b39d-d672e9592836] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:16.039344 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-1f58b1b9-9ac1-49cf-8e16-2fb191a98233 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:16.039947 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-1f58b1b9-9ac1-49cf-8e16-2fb191a98233 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:16.040931 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-1f58b1b9-9ac1-49cf-8e16-2fb191a98233 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:16.041372 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-1f58b1b9-9ac1-49cf-8e16-2fb191a98233 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:16.070336 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-1f58b1b9-9ac1-49cf-8e16-2fb191a98233 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046272 Jun 07 22:10:16.070890 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 477/947] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jun 7 22:10:16 2022] GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:10:16.195688 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-84410f8a-7a10-4535-ac7b-bba6365b1f9a tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:16.196456 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-84410f8a-7a10-4535-ac7b-bba6365b1f9a tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:16.204120 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-84410f8a-7a10-4535-ac7b-bba6365b1f9a tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:16.204569 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-84410f8a-7a10-4535-ac7b-bba6365b1f9a tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:16.206054 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-84410f8a-7a10-4535-ac7b-bba6365b1f9a tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:16.206557 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-84410f8a-7a10-4535-ac7b-bba6365b1f9a tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:16.484225 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-84410f8a-7a10-4535-ac7b-bba6365b1f9a tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:10:16.491779 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-84410f8a-7a10-4535-ac7b-bba6365b1f9a tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1674 microversion: 2.1 time: 0.299974 Jun 07 22:10:16.492350 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 471/948] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:10:16 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1674 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:10:16.592969 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-6402e98d-b464-406a-baac-462614c6e1d3 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:16.593573 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-6402e98d-b464-406a-baac-462614c6e1d3 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: f84b4686-8e5c-49af-b5ad-13f37e20f976] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:16.599570 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-6402e98d-b464-406a-baac-462614c6e1d3 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:16.600024 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-6402e98d-b464-406a-baac-462614c6e1d3 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:16.600776 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-6402e98d-b464-406a-baac-462614c6e1d3 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:16.601207 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-6402e98d-b464-406a-baac-462614c6e1d3 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:16.741530 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-6402e98d-b464-406a-baac-462614c6e1d3 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:10:16.751939 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-6402e98d-b464-406a-baac-462614c6e1d3 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976" status: 200 len: 1715 microversion: 2.1 time: 0.163028 Jun 07 22:10:16.752512 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 478/949] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:10:16 2022] GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976 => generated 1715 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:10:16.808237 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-0af9e3b6-1246-4080-9851-6173ac7f4f8c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:16.809168 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-0af9e3b6-1246-4080-9851-6173ac7f4f8c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: f84b4686-8e5c-49af-b5ad-13f37e20f976] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:16.816217 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0af9e3b6-1246-4080-9851-6173ac7f4f8c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:16.816517 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0af9e3b6-1246-4080-9851-6173ac7f4f8c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:16.817236 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0af9e3b6-1246-4080-9851-6173ac7f4f8c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:16.817792 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0af9e3b6-1246-4080-9851-6173ac7f4f8c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:16.902552 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.wsgi [None req-0af9e3b6-1246-4080-9851-6173ac7f4f8c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] HTTP exception thrown: Cannot 'detach_volume' instance f84b4686-8e5c-49af-b5ad-13f37e20f976 while it is in vm_state rescued Jun 07 22:10:16.905237 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-0af9e3b6-1246-4080-9851-6173ac7f4f8c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Request method failure captured: Jun 07 22:10:16.905237 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: request: DELETE /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976/os-volume_attachments/c193041b-a5dc-4a50-8b11-76dadfb0deec HTTP/1.1 Jun 07 22:10:16.905237 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Accept: application/json Jun 07 22:10:16.905237 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Accept-Encoding: identity Jun 07 22:10:16.905237 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Connection: close Jun 07 22:10:16.905237 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Content-Length: 0 Jun 07 22:10:16.905237 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Content-Type: application/json Jun 07 22:10:16.905237 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Host: 10.222.0.13 Jun 07 22:10:16.905237 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Openstack-System-Scope: None Jun 07 22:10:16.905237 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: User-Agent: python-urllib3/1.26.9 Jun 07 22:10:16.905237 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Auth-Token: gAAAAABin8sikwri0wz--bbwCQiRTo8aflsbVudHe_idy05qCCCm6kMV6CqJhWmtBn1AnbEoV22lfFfBtXzCrxKFJsUQou-LO31msxwdCukOro2yUZ7Ru7Jq7nfvAeg5tmJuzphYSRHzoedKYtMoC-7_d00L6jKIA57HYnc7FI-lfgXXUmmTM04 Jun 07 22:10:16.905237 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Domain-Id: None Jun 07 22:10:16.905237 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Domain-Name: None Jun 07 22:10:16.905237 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Identity-Status: Confirmed Jun 07 22:10:16.905237 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Is-Admin-Project: True Jun 07 22:10:16.905237 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Domain-Id: default Jun 07 22:10:16.905237 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Domain-Name: Default Jun 07 22:10:16.905237 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Id: 0a4fc48a5efe4d8b974757a5bf7d947e Jun 07 22:10:16.905237 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-676703940 Jun 07 22:10:16.905237 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Role: member,reader Jun 07 22:10:16.905237 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Roles: member,reader Jun 07 22:10:16.906870 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0a4fc48a5efe4d8b974757a5bf7d947e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_0a4fc48a5efe4d8b974757a5bf7d947e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0a4fc48a5efe4d8b974757a5bf7d947e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/0a4fc48a5efe4d8b974757a5bf7d947e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}] Jun 07 22:10:16.906870 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Tenant: tempest-ServerRescueNegativeTestJSON-676703940 Jun 07 22:10:16.906870 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Tenant-Id: 0a4fc48a5efe4d8b974757a5bf7d947e Jun 07 22:10:16.906870 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-676703940 Jun 07 22:10:16.906870 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User: tempest-ServerRescueNegativeTestJSON-676703940-project Jun 07 22:10:16.906870 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Domain-Id: default Jun 07 22:10:16.906870 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Domain-Name: Default Jun 07 22:10:16.906870 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Id: c44c1788959e4b339c9cd5aad4318496 Jun 07 22:10:16.906870 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Name: tempest-ServerRescueNegativeTestJSON-676703940-project Jun 07 22:10:16.906870 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: method: > Jun 07 22:10:16.906870 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: exception: Cannot 'detach_volume' instance f84b4686-8e5c-49af-b5ad-13f37e20f976 while it is in vm_state rescued Jun 07 22:10:16.907737 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: action_args: {'server_id': 'f84b4686-8e5c-49af-b5ad-13f37e20f976', 'id': 'c193041b-a5dc-4a50-8b11-76dadfb0deec'} Jun 07 22:10:16.907737 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 22:10:16.907737 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:10:16.907737 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 07 22:10:16.907737 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 07 22:10:16.907737 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 07 22:10:16.907737 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 07 22:10:16.907737 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 07 22:10:16.907737 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 07 22:10:16.907737 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f84b4686-8e5c-49af-b5ad-13f37e20f976 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 07 22:10:16.907737 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:10:16.907737 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:10:16.907737 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:10:16.907737 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:10:16.907737 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:10:16.907737 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:10:16.907737 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 22:10:16.907737 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 22:10:16.907737 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 22:10:16.907737 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 22:10:16.909115 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 07 22:10:16.909115 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 07 22:10:16.909115 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 07 22:10:16.909115 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 07 22:10:16.909115 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance f84b4686-8e5c-49af-b5ad-13f37e20f976 while it is in vm_state rescued Jun 07 22:10:16.909115 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:10:16.909115 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:10:16.909115 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:10:16.909115 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:10:16.909115 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:10:16.909115 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:10:16.909115 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 22:10:16.909115 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 22:10:16.909115 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance f84b4686-8e5c-49af-b5ad-13f37e20f976 while it is in vm_state rescued Jun 07 22:10:16.909115 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:10:16.909115 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-0af9e3b6-1246-4080-9851-6173ac7f4f8c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Returning 409 to user: Cannot 'detach_volume' instance f84b4686-8e5c-49af-b5ad-13f37e20f976 while it is in vm_state rescued {{(pid=117970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 22:10:16.910406 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-0af9e3b6-1246-4080-9851-6173ac7f4f8c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976/os-volume_attachments/c193041b-a5dc-4a50-8b11-76dadfb0deec" status: 409 len: 152 microversion: 2.1 time: 0.103968 Jun 07 22:10:16.910406 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 472/950] 10.222.0.13 () {58 vars in 1415 bytes} [Tue Jun 7 22:10:16 2022] DELETE /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976/os-volume_attachments/c193041b-a5dc-4a50-8b11-76dadfb0deec => generated 152 bytes in 105 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 07 22:10:16.917000 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-329d85b6-c15b-4b1f-b5c0-4d9c45dd1ca7 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:10:16.917767 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-329d85b6-c15b-4b1f-b5c0-4d9c45dd1ca7 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: f84b4686-8e5c-49af-b5ad-13f37e20f976] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:16.925019 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-329d85b6-c15b-4b1f-b5c0-4d9c45dd1ca7 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:16.925553 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-329d85b6-c15b-4b1f-b5c0-4d9c45dd1ca7 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:16.926377 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-329d85b6-c15b-4b1f-b5c0-4d9c45dd1ca7 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:16.926907 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-329d85b6-c15b-4b1f-b5c0-4d9c45dd1ca7 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:16.996270 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-329d85b6-c15b-4b1f-b5c0-4d9c45dd1ca7 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "POST /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976/action" status: 202 len: 0 microversion: 2.1 time: 0.082869 Jun 07 22:10:16.996824 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 479/951] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Jun 7 22:10:16 2022] POST /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 22:10:17.005525 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-1521d55a-a251-43da-89f2-b72e770e6997 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:17.006166 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-1521d55a-a251-43da-89f2-b72e770e6997 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: f84b4686-8e5c-49af-b5ad-13f37e20f976] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:17.012880 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1521d55a-a251-43da-89f2-b72e770e6997 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:17.013507 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1521d55a-a251-43da-89f2-b72e770e6997 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:17.014479 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1521d55a-a251-43da-89f2-b72e770e6997 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:17.014943 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1521d55a-a251-43da-89f2-b72e770e6997 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:17.082521 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-7044e6fd-a11f-442a-959f-23c9e9391f40 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:17.083655 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-7044e6fd-a11f-442a-959f-23c9e9391f40 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 5704eeef-7ef8-4e6d-b39d-d672e9592836] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:17.090174 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-7044e6fd-a11f-442a-959f-23c9e9391f40 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:17.090700 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-7044e6fd-a11f-442a-959f-23c9e9391f40 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:17.092324 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-7044e6fd-a11f-442a-959f-23c9e9391f40 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:17.092852 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-7044e6fd-a11f-442a-959f-23c9e9391f40 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:17.124975 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-7044e6fd-a11f-442a-959f-23c9e9391f40 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047164 Jun 07 22:10:17.125724 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 480/952] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jun 7 22:10:17 2022] GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 07 22:10:17.185351 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-6180935b-7d1e-4212-9a7f-a910ce636a11 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:17.185847 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-6180935b-7d1e-4212-9a7f-a910ce636a11 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 5704eeef-7ef8-4e6d-b39d-d672e9592836] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:17.191925 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-6180935b-7d1e-4212-9a7f-a910ce636a11 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:17.192380 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-6180935b-7d1e-4212-9a7f-a910ce636a11 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:17.193141 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-6180935b-7d1e-4212-9a7f-a910ce636a11 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:17.193580 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-6180935b-7d1e-4212-9a7f-a910ce636a11 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:17.220131 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-6180935b-7d1e-4212-9a7f-a910ce636a11 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 5704eeef-7ef8-4e6d-b39d-d672e9592836] Going to try to terminate instance {{(pid=117971) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 22:10:17.235246 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-1521d55a-a251-43da-89f2-b72e770e6997 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:10:17.243938 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-1521d55a-a251-43da-89f2-b72e770e6997 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976" status: 200 len: 1723 microversion: 2.1 time: 0.242203 Jun 07 22:10:17.254436 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 473/953] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:10:17 2022] GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976 => generated 1723 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:10:17.301927 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-6180935b-7d1e-4212-9a7f-a910ce636a11 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "DELETE /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836" status: 204 len: 0 microversion: 2.1 time: 0.120075 Jun 07 22:10:17.302622 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 481/954] 10.222.0.13 () {58 vars in 1238 bytes} [Tue Jun 7 22:10:17 2022] DELETE /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 07 22:10:17.313598 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-495ca5fa-0396-4ceb-b150-25b6154e8274 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:17.314214 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-495ca5fa-0396-4ceb-b150-25b6154e8274 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 5704eeef-7ef8-4e6d-b39d-d672e9592836] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:17.321587 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-495ca5fa-0396-4ceb-b150-25b6154e8274 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:17.322038 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-495ca5fa-0396-4ceb-b150-25b6154e8274 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:17.322805 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-495ca5fa-0396-4ceb-b150-25b6154e8274 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:17.323241 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-495ca5fa-0396-4ceb-b150-25b6154e8274 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:17.455006 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-495ca5fa-0396-4ceb-b150-25b6154e8274 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:10:17.462447 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-495ca5fa-0396-4ceb-b150-25b6154e8274 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836" status: 200 len: 1682 microversion: 2.1 time: 0.155159 Jun 07 22:10:17.463011 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 474/955] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:10:17 2022] GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:10:17.509892 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-52e4c322-bdf4-41a2-8a8f-e2fd6db32a9d tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:17.510510 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-52e4c322-bdf4-41a2-8a8f-e2fd6db32a9d tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:17.516783 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-52e4c322-bdf4-41a2-8a8f-e2fd6db32a9d tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:17.517228 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-52e4c322-bdf4-41a2-8a8f-e2fd6db32a9d tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:17.517978 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-52e4c322-bdf4-41a2-8a8f-e2fd6db32a9d tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:17.518405 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-52e4c322-bdf4-41a2-8a8f-e2fd6db32a9d tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:17.646584 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-52e4c322-bdf4-41a2-8a8f-e2fd6db32a9d tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:10:17.649020 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:10:17.655916 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-52e4c322-bdf4-41a2-8a8f-e2fd6db32a9d tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1674 microversion: 2.1 time: 0.150376 Jun 07 22:10:17.656476 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 482/956] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:10:17 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1674 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:10:18.262019 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-5dddb3d3-dec8-4892-9b74-d0e92f8b3ecd tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:18.262631 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-5dddb3d3-dec8-4892-9b74-d0e92f8b3ecd tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: f84b4686-8e5c-49af-b5ad-13f37e20f976] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:18.270041 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-5dddb3d3-dec8-4892-9b74-d0e92f8b3ecd tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:18.270494 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-5dddb3d3-dec8-4892-9b74-d0e92f8b3ecd tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:18.271274 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-5dddb3d3-dec8-4892-9b74-d0e92f8b3ecd tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:18.271720 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-5dddb3d3-dec8-4892-9b74-d0e92f8b3ecd tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:18.480652 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-7e1502b0-8e96-4ae1-a095-85e3c5ca57b1 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:18.481266 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-7e1502b0-8e96-4ae1-a095-85e3c5ca57b1 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 5704eeef-7ef8-4e6d-b39d-d672e9592836] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:18.488488 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-7e1502b0-8e96-4ae1-a095-85e3c5ca57b1 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:18.488943 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-7e1502b0-8e96-4ae1-a095-85e3c5ca57b1 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:18.489716 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-7e1502b0-8e96-4ae1-a095-85e3c5ca57b1 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:18.490153 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-7e1502b0-8e96-4ae1-a095-85e3c5ca57b1 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:18.530937 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-5dddb3d3-dec8-4892-9b74-d0e92f8b3ecd tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:10:18.539247 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-5dddb3d3-dec8-4892-9b74-d0e92f8b3ecd tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976" status: 200 len: 1723 microversion: 2.1 time: 0.281085 Jun 07 22:10:18.539822 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 475/957] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:10:18 2022] GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976 => generated 1723 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:10:18.638824 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-7e1502b0-8e96-4ae1-a095-85e3c5ca57b1 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:10:18.646588 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-7e1502b0-8e96-4ae1-a095-85e3c5ca57b1 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836" status: 200 len: 1682 microversion: 2.1 time: 0.170708 Jun 07 22:10:18.647189 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 483/958] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:10:18 2022] GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836 => generated 1682 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:10:18.673805 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-066b0b52-915a-4a35-b8c2-1fdffa8fd85a tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:18.674443 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-066b0b52-915a-4a35-b8c2-1fdffa8fd85a tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:18.680399 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-066b0b52-915a-4a35-b8c2-1fdffa8fd85a tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:18.680851 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-066b0b52-915a-4a35-b8c2-1fdffa8fd85a tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:18.681641 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-066b0b52-915a-4a35-b8c2-1fdffa8fd85a tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:18.682076 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-066b0b52-915a-4a35-b8c2-1fdffa8fd85a tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:18.936274 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-066b0b52-915a-4a35-b8c2-1fdffa8fd85a tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:10:18.944056 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-066b0b52-915a-4a35-b8c2-1fdffa8fd85a tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1651 microversion: 2.1 time: 0.274655 Jun 07 22:10:18.944709 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 476/959] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:10:18 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1651 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:10:18.961150 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-6b30dafa-3937-49ee-9d69-15a04cae56d4 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:10:18.967704 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-6b30dafa-3937-49ee-9d69-15a04cae56d4 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:18.968151 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-6b30dafa-3937-49ee-9d69-15a04cae56d4 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:19.033147 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-6b30dafa-3937-49ee-9d69-15a04cae56d4 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Going to try to start instance {{(pid=117971) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 07 22:10:19.079137 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-6b30dafa-3937-49ee-9d69-15a04cae56d4 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "POST /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609/action" status: 202 len: 0 microversion: 2.1 time: 0.121757 Jun 07 22:10:19.079954 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 484/960] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Jun 7 22:10:18 2022] POST /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 22:10:19.087905 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-2bbbe80d-7147-4720-a974-9aae04c99389 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:19.088769 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-2bbbe80d-7147-4720-a974-9aae04c99389 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:19.098580 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-2bbbe80d-7147-4720-a974-9aae04c99389 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:19.099111 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-2bbbe80d-7147-4720-a974-9aae04c99389 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:19.100728 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-2bbbe80d-7147-4720-a974-9aae04c99389 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:19.100728 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-2bbbe80d-7147-4720-a974-9aae04c99389 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:19.315184 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-2bbbe80d-7147-4720-a974-9aae04c99389 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:10:19.323524 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-2bbbe80d-7147-4720-a974-9aae04c99389 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1660 microversion: 2.1 time: 0.239321 Jun 07 22:10:19.324099 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 477/961] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:10:19 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1660 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:10:19.472493 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [req-7c6e7df0-2bc4-483f-b5f0-5aa17f40d816 req-ca06f6f7-0ca9-46e9-85e6-e65726af1d27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5704eeef-7ef8-4e6d-b39d-d672e9592836", "name": "network-vif-deleted", "tag": "f75804a7-9ce5-44ca-82e4-e1f8a373373a"}]} {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:10:19.481249 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-7c6e7df0-2bc4-483f-b5f0-5aa17f40d816 req-ca06f6f7-0ca9-46e9-85e6-e65726af1d27 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:19.481887 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-7c6e7df0-2bc4-483f-b5f0-5aa17f40d816 req-ca06f6f7-0ca9-46e9-85e6-e65726af1d27 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:19.493692 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.compute.server_external_events [req-7c6e7df0-2bc4-483f-b5f0-5aa17f40d816 req-ca06f6f7-0ca9-46e9-85e6-e65726af1d27 service nova] Creating event network-vif-deleted:f75804a7-9ce5-44ca-82e4-e1f8a373373a for instance 5704eeef-7ef8-4e6d-b39d-d672e9592836 on hv-cinder-83552 Jun 07 22:10:19.499090 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [req-7c6e7df0-2bc4-483f-b5f0-5aa17f40d816 req-ca06f6f7-0ca9-46e9-85e6-e65726af1d27 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030696 Jun 07 22:10:19.499723 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 485/962] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:10:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:10:19.556631 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-9758d07d-b42a-472a-9b3a-7448275cd9b3 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:19.557349 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-9758d07d-b42a-472a-9b3a-7448275cd9b3 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: f84b4686-8e5c-49af-b5ad-13f37e20f976] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:19.565030 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-9758d07d-b42a-472a-9b3a-7448275cd9b3 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:19.565747 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-9758d07d-b42a-472a-9b3a-7448275cd9b3 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:19.566694 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-9758d07d-b42a-472a-9b3a-7448275cd9b3 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:19.567129 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-9758d07d-b42a-472a-9b3a-7448275cd9b3 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:19.665682 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-7a531286-d94c-442a-8b83-dcde2f93c02c tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:19.666448 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-7a531286-d94c-442a-8b83-dcde2f93c02c tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 5704eeef-7ef8-4e6d-b39d-d672e9592836] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:19.674505 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-7a531286-d94c-442a-8b83-dcde2f93c02c tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:19.675907 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-7a531286-d94c-442a-8b83-dcde2f93c02c tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:19.677730 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-7a531286-d94c-442a-8b83-dcde2f93c02c tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:19.678369 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-7a531286-d94c-442a-8b83-dcde2f93c02c tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:19.710831 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-9758d07d-b42a-472a-9b3a-7448275cd9b3 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:10:19.720101 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-9758d07d-b42a-472a-9b3a-7448275cd9b3 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976" status: 200 len: 1723 microversion: 2.1 time: 0.167492 Jun 07 22:10:19.724585 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 478/963] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:10:19 2022] GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:10:19.744854 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-7a531286-d94c-442a-8b83-dcde2f93c02c tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:10:19.752884 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-7a531286-d94c-442a-8b83-dcde2f93c02c tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836" status: 200 len: 1614 microversion: 2.1 time: 0.091556 Jun 07 22:10:19.753617 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 486/964] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:10:19 2022] GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836 => generated 1614 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:10:20.342252 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-b01ab704-f13d-4199-978b-7d5aa6e03612 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:20.342866 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-b01ab704-f13d-4199-978b-7d5aa6e03612 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:20.349939 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-b01ab704-f13d-4199-978b-7d5aa6e03612 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:20.350453 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-b01ab704-f13d-4199-978b-7d5aa6e03612 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:20.351249 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-b01ab704-f13d-4199-978b-7d5aa6e03612 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:20.352005 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-b01ab704-f13d-4199-978b-7d5aa6e03612 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:20.488480 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-b01ab704-f13d-4199-978b-7d5aa6e03612 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:10:20.496080 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-b01ab704-f13d-4199-978b-7d5aa6e03612 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1660 microversion: 2.1 time: 0.158580 Jun 07 22:10:20.496639 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 479/965] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:10:20 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1660 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:10:20.738380 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-2420a108-9200-4062-8dfb-376f10f66c36 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:20.738927 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-2420a108-9200-4062-8dfb-376f10f66c36 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: f84b4686-8e5c-49af-b5ad-13f37e20f976] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:20.745504 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-2420a108-9200-4062-8dfb-376f10f66c36 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:20.745945 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-2420a108-9200-4062-8dfb-376f10f66c36 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:20.746691 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-2420a108-9200-4062-8dfb-376f10f66c36 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:20.747119 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-2420a108-9200-4062-8dfb-376f10f66c36 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:20.770293 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-0ea5e712-da87-4772-9bd6-cd677f641a6d tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:20.771100 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-0ea5e712-da87-4772-9bd6-cd677f641a6d tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 5704eeef-7ef8-4e6d-b39d-d672e9592836] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:20.777163 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0ea5e712-da87-4772-9bd6-cd677f641a6d tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:20.777619 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0ea5e712-da87-4772-9bd6-cd677f641a6d tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:20.778371 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0ea5e712-da87-4772-9bd6-cd677f641a6d tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:20.779653 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0ea5e712-da87-4772-9bd6-cd677f641a6d tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:20.782423 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_cell1:SELECT=100 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:10:20.842418 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-0ea5e712-da87-4772-9bd6-cd677f641a6d tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:10:20.850175 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-0ea5e712-da87-4772-9bd6-cd677f641a6d tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836" status: 200 len: 1614 microversion: 2.1 time: 0.083517 Jun 07 22:10:20.860440 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 480/966] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:10:20 2022] GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836 => generated 1614 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:10:20.881020 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-2420a108-9200-4062-8dfb-376f10f66c36 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:10:20.890766 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-2420a108-9200-4062-8dfb-376f10f66c36 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976" status: 200 len: 1723 microversion: 2.1 time: 0.156141 Jun 07 22:10:20.891565 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 487/967] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:10:20 2022] GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:10:21.513255 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-f63928f8-8fd3-41d6-9b89-4284f9dfd89b tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:21.513984 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-f63928f8-8fd3-41d6-9b89-4284f9dfd89b tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:21.520302 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f63928f8-8fd3-41d6-9b89-4284f9dfd89b tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:21.520749 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f63928f8-8fd3-41d6-9b89-4284f9dfd89b tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:21.521533 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f63928f8-8fd3-41d6-9b89-4284f9dfd89b tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:21.521967 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f63928f8-8fd3-41d6-9b89-4284f9dfd89b tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:21.647410 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-f63928f8-8fd3-41d6-9b89-4284f9dfd89b tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:10:21.656693 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-f63928f8-8fd3-41d6-9b89-4284f9dfd89b tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1660 microversion: 2.1 time: 0.147081 Jun 07 22:10:21.657716 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 481/968] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:10:21 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1660 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:10:21.868814 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-ff99e4cc-7fd9-4d26-be9c-41db009420b8 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:21.869423 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-ff99e4cc-7fd9-4d26-be9c-41db009420b8 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 5704eeef-7ef8-4e6d-b39d-d672e9592836] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:21.876532 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ff99e4cc-7fd9-4d26-be9c-41db009420b8 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:21.876985 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ff99e4cc-7fd9-4d26-be9c-41db009420b8 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:21.877748 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ff99e4cc-7fd9-4d26-be9c-41db009420b8 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:21.878187 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ff99e4cc-7fd9-4d26-be9c-41db009420b8 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:21.908604 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-b65b4c27-171a-4ec4-be2f-7ce80f22b2c7 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:21.908855 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ff99e4cc-7fd9-4d26-be9c-41db009420b8 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:21.909223 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ff99e4cc-7fd9-4d26-be9c-41db009420b8 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:21.909356 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-b65b4c27-171a-4ec4-be2f-7ce80f22b2c7 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: f84b4686-8e5c-49af-b5ad-13f37e20f976] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:21.909679 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.objects.instance [None req-ff99e4cc-7fd9-4d26-be9c-41db009420b8 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lazy-loading 'fault' on Instance uuid 5704eeef-7ef8-4e6d-b39d-d672e9592836 {{(pid=117971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 22:10:21.915169 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-b65b4c27-171a-4ec4-be2f-7ce80f22b2c7 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:21.915650 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-b65b4c27-171a-4ec4-be2f-7ce80f22b2c7 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:21.916414 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-b65b4c27-171a-4ec4-be2f-7ce80f22b2c7 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:21.916852 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-b65b4c27-171a-4ec4-be2f-7ce80f22b2c7 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:21.950051 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-ff99e4cc-7fd9-4d26-be9c-41db009420b8 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:10:21.958163 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-ff99e4cc-7fd9-4d26-be9c-41db009420b8 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836" status: 200 len: 1332 microversion: 2.1 time: 0.093369 Jun 07 22:10:21.958730 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 488/969] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:10:21 2022] GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836 => generated 1332 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:10:22.055259 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-b65b4c27-171a-4ec4-be2f-7ce80f22b2c7 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:10:22.063835 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-b65b4c27-171a-4ec4-be2f-7ce80f22b2c7 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976" status: 200 len: 1723 microversion: 2.1 time: 0.159000 Jun 07 22:10:22.064437 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 482/970] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:10:21 2022] GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:10:22.675399 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-a64a58b4-5085-4741-9123-7464078fee6c tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:22.676030 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-a64a58b4-5085-4741-9123-7464078fee6c tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:22.682060 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a64a58b4-5085-4741-9123-7464078fee6c tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:22.682509 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a64a58b4-5085-4741-9123-7464078fee6c tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:22.683272 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a64a58b4-5085-4741-9123-7464078fee6c tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:22.683738 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a64a58b4-5085-4741-9123-7464078fee6c tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:22.816396 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-a64a58b4-5085-4741-9123-7464078fee6c tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:10:22.823795 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-a64a58b4-5085-4741-9123-7464078fee6c tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1660 microversion: 2.1 time: 0.152381 Jun 07 22:10:22.824372 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 489/971] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:10:22 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1660 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:10:22.976232 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-77d11570-d37e-4404-9925-9f54029fdcb3 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:22.977097 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-77d11570-d37e-4404-9925-9f54029fdcb3 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 5704eeef-7ef8-4e6d-b39d-d672e9592836] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:22.979607 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:10:22.986456 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-77d11570-d37e-4404-9925-9f54029fdcb3 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:22.986909 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-77d11570-d37e-4404-9925-9f54029fdcb3 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:22.987725 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-77d11570-d37e-4404-9925-9f54029fdcb3 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:22.988169 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-77d11570-d37e-4404-9925-9f54029fdcb3 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:23.004080 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.wsgi [None req-77d11570-d37e-4404-9925-9f54029fdcb3 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] HTTP exception thrown: Instance 5704eeef-7ef8-4e6d-b39d-d672e9592836 could not be found. Jun 07 22:10:23.005634 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-77d11570-d37e-4404-9925-9f54029fdcb3 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Request method failure captured: Jun 07 22:10:23.005634 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: request: GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836 HTTP/1.1 Jun 07 22:10:23.005634 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Accept: application/json Jun 07 22:10:23.005634 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Accept-Encoding: identity Jun 07 22:10:23.005634 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Connection: close Jun 07 22:10:23.005634 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Content-Length: 0 Jun 07 22:10:23.005634 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Content-Type: application/json Jun 07 22:10:23.005634 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Host: 10.222.0.13 Jun 07 22:10:23.005634 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Openstack-System-Scope: None Jun 07 22:10:23.005634 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: User-Agent: python-urllib3/1.26.9 Jun 07 22:10:23.005634 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Auth-Token: gAAAAABin8srQLbStzUvCeAnRNadMyGlcKFPPrFg9QuKcDpjIyywTcK8viTuRoYw24qPuVh7wMg6UWBPhX8hggkc6BZRBiLlvXhF5-X03MFchuLsFFC__9JBLL5O-wkDCN77ZFc33WSFPA37h4CwlIMlU5FumSkwBM-s6ELIPTrdhu_0TKT1s2Y Jun 07 22:10:23.005634 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Domain-Id: None Jun 07 22:10:23.005634 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Domain-Name: None Jun 07 22:10:23.005634 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Identity-Status: Confirmed Jun 07 22:10:23.005634 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Is-Admin-Project: True Jun 07 22:10:23.005634 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Domain-Id: default Jun 07 22:10:23.005634 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Domain-Name: Default Jun 07 22:10:23.005634 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Id: 49d73c22e28a450a99d0952aa686dccf Jun 07 22:10:23.005634 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Name: tempest-AttachVolumeNegativeTest-1740363357 Jun 07 22:10:23.005634 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Role: member,reader Jun 07 22:10:23.005634 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Roles: member,reader Jun 07 22:10:23.007030 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/49d73c22e28a450a99d0952aa686dccf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_49d73c22e28a450a99d0952aa686dccf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/49d73c22e28a450a99d0952aa686dccf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/49d73c22e28a450a99d0952aa686dccf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}] Jun 07 22:10:23.007030 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Tenant: tempest-AttachVolumeNegativeTest-1740363357 Jun 07 22:10:23.007030 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Tenant-Id: 49d73c22e28a450a99d0952aa686dccf Jun 07 22:10:23.007030 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1740363357 Jun 07 22:10:23.007030 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User: tempest-AttachVolumeNegativeTest-1740363357-project Jun 07 22:10:23.007030 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Domain-Id: default Jun 07 22:10:23.007030 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Domain-Name: Default Jun 07 22:10:23.007030 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Id: 607b70b4d6e14c95ae2880dd3577c8ae Jun 07 22:10:23.007030 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Name: tempest-AttachVolumeNegativeTest-1740363357-project Jun 07 22:10:23.007030 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: method: > Jun 07 22:10:23.007030 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: exception: Instance 5704eeef-7ef8-4e6d-b39d-d672e9592836 could not be found. Jun 07 22:10:23.007030 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: action_args: {'id': '5704eeef-7ef8-4e6d-b39d-d672e9592836'} Jun 07 22:10:23.007827 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 22:10:23.007827 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:10:23.007827 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 22:10:23.007827 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 22:10:23.007827 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 22:10:23.007827 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 22:10:23.007827 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 22:10:23.007827 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 22:10:23.007827 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 22:10:23.007827 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 22:10:23.007827 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5704eeef-7ef8-4e6d-b39d-d672e9592836 could not be found. Jun 07 22:10:23.007827 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:10:23.007827 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:10:23.007827 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:10:23.007827 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:10:23.007827 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:10:23.007827 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:10:23.007827 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 22:10:23.007827 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 22:10:23.007827 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 22:10:23.009088 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 22:10:23.009088 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 22:10:23.009088 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 22:10:23.009088 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 22:10:23.009088 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 22:10:23.009088 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 22:10:23.009088 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 22:10:23.009088 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5704eeef-7ef8-4e6d-b39d-d672e9592836 could not be found. Jun 07 22:10:23.009088 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:10:23.009088 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:10:23.009088 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:10:23.009088 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:10:23.009088 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:10:23.009088 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:10:23.009088 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 22:10:23.009088 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 22:10:23.009088 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5704eeef-7ef8-4e6d-b39d-d672e9592836 could not be found. Jun 07 22:10:23.009088 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:10:23.010630 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-77d11570-d37e-4404-9925-9f54029fdcb3 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Returning 404 to user: Instance 5704eeef-7ef8-4e6d-b39d-d672e9592836 could not be found. {{(pid=117970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 22:10:23.010630 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-77d11570-d37e-4404-9925-9f54029fdcb3 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836" status: 404 len: 111 microversion: 2.1 time: 0.035100 Jun 07 22:10:23.010630 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 483/972] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:10:22 2022] GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 22:10:23.016258 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-70485998-5417-4131-a0e2-e0b4a4e05640 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '.version_select at 0x7f92f21905e0>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:23.033496 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-70485998-5417-4131-a0e2-e0b4a4e05640 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1587080771" status: 202 len: 0 microversion: 2.1 time: 0.021115 Jun 07 22:10:23.034053 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 490/973] 10.222.0.13 () {58 vars in 1220 bytes} [Tue Jun 7 22:10:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1587080771 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 07 22:10:23.080326 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-f930e06f-7265-4da8-b5ae-37f836c3bb9b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:23.080935 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-f930e06f-7265-4da8-b5ae-37f836c3bb9b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: f84b4686-8e5c-49af-b5ad-13f37e20f976] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:23.086861 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f930e06f-7265-4da8-b5ae-37f836c3bb9b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:23.087312 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f930e06f-7265-4da8-b5ae-37f836c3bb9b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:23.088106 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f930e06f-7265-4da8-b5ae-37f836c3bb9b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:23.088551 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f930e06f-7265-4da8-b5ae-37f836c3bb9b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:23.242400 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-f930e06f-7265-4da8-b5ae-37f836c3bb9b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:10:23.251053 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-f930e06f-7265-4da8-b5ae-37f836c3bb9b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976" status: 200 len: 1729 microversion: 2.1 time: 0.174731 Jun 07 22:10:23.251672 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 484/974] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:10:23 2022] GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976 => generated 1729 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:10:23.269946 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-56695f11-9a83-436f-897b-878ec87bc088 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:23.269946 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-56695f11-9a83-436f-897b-878ec87bc088 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: f84b4686-8e5c-49af-b5ad-13f37e20f976] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:23.275739 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-56695f11-9a83-436f-897b-878ec87bc088 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:23.276281 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-56695f11-9a83-436f-897b-878ec87bc088 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:23.277176 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-56695f11-9a83-436f-897b-878ec87bc088 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:23.277761 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-56695f11-9a83-436f-897b-878ec87bc088 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:23.422151 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-56695f11-9a83-436f-897b-878ec87bc088 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.158252 Jun 07 22:10:23.422831 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 491/975] 10.222.0.13 () {58 vars in 1274 bytes} [Tue Jun 7 22:10:23 2022] GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976/os-interface => generated 285 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:10:23.737951 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-2c9bddfb-81e4-4532-88e1-d8d893e00b66 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Action: 'create', calling method: .version_select at 0x7f92f17289d0>, body: {"keypair": {"name": "tempest-keypair-615576509", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHg03gAas2e8PRxEYoHgkeQas15sLkfN2YVuuf5TWayY8Cb3zeg6j4WG0Ero/VmZVnO3qv7gE/PpJKGyGlXL4GTyLNlgEdeGpR7pUdmqzSu00qCXKr+vMjkdMRGeHfZ6bA=="}} {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:10:23.762416 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.quota [None req-2c9bddfb-81e4-4532-88e1-d8d893e00b66 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Getting quotas for project 49d73c22e28a450a99d0952aa686dccf. Resources: {'key_pairs'} {{(pid=117970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 22:10:23.771842 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.quota [None req-2c9bddfb-81e4-4532-88e1-d8d893e00b66 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Getting quotas for user 607b70b4d6e14c95ae2880dd3577c8ae and project 49d73c22e28a450a99d0952aa686dccf. Resources: {'key_pairs'} {{(pid=117970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 22:10:23.803441 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-2c9bddfb-81e4-4532-88e1-d8d893e00b66 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.069351 Jun 07 22:10:23.804358 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 485/976] 10.222.0.13 () {60 vars in 1158 bytes} [Tue Jun 7 22:10:23 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:10:23.840995 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-9079c2ed-a15c-49e8-aa2d-43dd3d9a8fb8 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:23.842266 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-9079c2ed-a15c-49e8-aa2d-43dd3d9a8fb8 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:23.854899 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-9079c2ed-a15c-49e8-aa2d-43dd3d9a8fb8 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:23.855498 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-9079c2ed-a15c-49e8-aa2d-43dd3d9a8fb8 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:23.856524 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-9079c2ed-a15c-49e8-aa2d-43dd3d9a8fb8 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:23.858302 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-9079c2ed-a15c-49e8-aa2d-43dd3d9a8fb8 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:23.992709 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-9079c2ed-a15c-49e8-aa2d-43dd3d9a8fb8 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:10:24.000645 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-9079c2ed-a15c-49e8-aa2d-43dd3d9a8fb8 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1664 microversion: 2.1 time: 0.163531 Jun 07 22:10:24.001205 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 492/977] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:10:23 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1664 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:10:24.704783 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [req-e3079104-783d-4ca1-a3b1-03fc05c06a94 req-368f0f8a-f38b-4895-891b-b93bbf95c2e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f84b4686-8e5c-49af-b5ad-13f37e20f976", "tag": "3d9f0611-4530-459f-983c-a70170e27b7f"}]} {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:10:24.717569 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [req-e3079104-783d-4ca1-a3b1-03fc05c06a94 req-368f0f8a-f38b-4895-891b-b93bbf95c2e1 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:24.718319 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [req-e3079104-783d-4ca1-a3b1-03fc05c06a94 req-368f0f8a-f38b-4895-891b-b93bbf95c2e1 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:24.735319 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.compute.server_external_events [req-e3079104-783d-4ca1-a3b1-03fc05c06a94 req-368f0f8a-f38b-4895-891b-b93bbf95c2e1 service nova] Creating event network-changed:3d9f0611-4530-459f-983c-a70170e27b7f for instance f84b4686-8e5c-49af-b5ad-13f37e20f976 on hv-cinder-83552 Jun 07 22:10:24.741605 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [req-e3079104-783d-4ca1-a3b1-03fc05c06a94 req-368f0f8a-f38b-4895-891b-b93bbf95c2e1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043014 Jun 07 22:10:24.742463 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 486/978] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:10:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:10:25.363628 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-93086da6-c704-40e4-8ad7-0876bc8a2b86 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1360333977", "imageRef": "87e2e140-6de8-4531-9681-d0a3e069622d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7dfa279a-8a9f-49b5-8669-931f3a43bf9f"}], "security_groups": [{"name": "tempest-securitygroup--1269580663"}], "key_name": "tempest-keypair-615576509", "user_data": "}} {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:10:25.465102 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.network.neutron [None req-93086da6-c704-40e4-8ad7-0876bc8a2b86 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] validate_networks() for [('7dfa279a-8a9f-49b5-8669-931f3a43bf9f', None, None, None, None, None)] {{(pid=117971) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 22:10:25.874840 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.virt.hardware [None req-93086da6-c704-40e4-8ad7-0876bc8a2b86 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Flavor limits 0:0:0 {{(pid=117971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 22:10:25.875273 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.virt.hardware [None req-93086da6-c704-40e4-8ad7-0876bc8a2b86 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Image limits 0:0:0 {{(pid=117971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 22:10:25.875815 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.virt.hardware [None req-93086da6-c704-40e4-8ad7-0876bc8a2b86 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Flavor pref 0:0:0 {{(pid=117971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 22:10:25.876224 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.virt.hardware [None req-93086da6-c704-40e4-8ad7-0876bc8a2b86 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Image pref 0:0:0 {{(pid=117971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 22:10:25.876630 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.virt.hardware [None req-93086da6-c704-40e4-8ad7-0876bc8a2b86 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 22:10:25.878663 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:10:25.888429 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-93086da6-c704-40e4-8ad7-0876bc8a2b86 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:25.888896 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-93086da6-c704-40e4-8ad7-0876bc8a2b86 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:25.889684 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-93086da6-c704-40e4-8ad7-0876bc8a2b86 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:25.890119 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-93086da6-c704-40e4-8ad7-0876bc8a2b86 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:25.908352 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.quota [None req-93086da6-c704-40e4-8ad7-0876bc8a2b86 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Getting quotas for project 49d73c22e28a450a99d0952aa686dccf. Resources: {'cores', 'ram', 'instances'} {{(pid=117971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 22:10:25.912279 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.quota [None req-93086da6-c704-40e4-8ad7-0876bc8a2b86 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Getting quotas for user 607b70b4d6e14c95ae2880dd3577c8ae and project 49d73c22e28a450a99d0952aa686dccf. Resources: {'cores', 'ram', 'instances'} {{(pid=117971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 22:10:25.923210 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-93086da6-c704-40e4-8ad7-0876bc8a2b86 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Going to run 1 instances... {{(pid=117971) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 22:10:25.925498 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-93086da6-c704-40e4-8ad7-0876bc8a2b86 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: b8a810a4-60df-4062-baae-8f11e0615a49] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='87e2e140-6de8-4531-9681-d0a3e069622d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 22:10:25.970939 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-93086da6-c704-40e4-8ad7-0876bc8a2b86 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.611748 Jun 07 22:10:25.971610 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 493/979] 10.222.0.13 () {60 vars in 1146 bytes} [Tue Jun 7 22:10:25 2022] POST /compute/v2.1/servers => generated 402 bytes in 613 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 22:10:25.983195 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-54d59ff6-175a-4810-9e92-6e70a7e78f0c tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:25.984014 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-54d59ff6-175a-4810-9e92-6e70a7e78f0c tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: b8a810a4-60df-4062-baae-8f11e0615a49] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:26.039908 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-54d59ff6-175a-4810-9e92-6e70a7e78f0c tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:10:26.046502 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-54d59ff6-175a-4810-9e92-6e70a7e78f0c tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/b8a810a4-60df-4062-baae-8f11e0615a49" status: 200 len: 1241 microversion: 2.1 time: 0.068403 Jun 07 22:10:26.047072 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 487/980] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:10:25 2022] GET /compute/v2.1/servers/b8a810a4-60df-4062-baae-8f11e0615a49 => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:10:26.757341 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [req-318dbe76-a4fb-42a5-a4ee-7fa2e715d77c req-2840fe7b-5c56-45f4-a394-de63ede9b934 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f84b4686-8e5c-49af-b5ad-13f37e20f976", "tag": "3d9f0611-4530-459f-983c-a70170e27b7f"}]} {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:10:26.766913 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-318dbe76-a4fb-42a5-a4ee-7fa2e715d77c req-2840fe7b-5c56-45f4-a394-de63ede9b934 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:26.767373 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-318dbe76-a4fb-42a5-a4ee-7fa2e715d77c req-2840fe7b-5c56-45f4-a394-de63ede9b934 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:26.777813 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.compute.server_external_events [req-318dbe76-a4fb-42a5-a4ee-7fa2e715d77c req-2840fe7b-5c56-45f4-a394-de63ede9b934 service nova] Creating event network-changed:3d9f0611-4530-459f-983c-a70170e27b7f for instance f84b4686-8e5c-49af-b5ad-13f37e20f976 on hv-cinder-83552 Jun 07 22:10:26.783956 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [req-318dbe76-a4fb-42a5-a4ee-7fa2e715d77c req-2840fe7b-5c56-45f4-a394-de63ede9b934 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030814 Jun 07 22:10:26.784558 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 494/981] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:10:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:10:27.064335 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-bfb0aa4e-e897-40d2-9872-d2f90a8f0971 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:27.064973 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-bfb0aa4e-e897-40d2-9872-d2f90a8f0971 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: b8a810a4-60df-4062-baae-8f11e0615a49] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:27.072485 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-bfb0aa4e-e897-40d2-9872-d2f90a8f0971 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:27.072935 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-bfb0aa4e-e897-40d2-9872-d2f90a8f0971 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:27.073700 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-bfb0aa4e-e897-40d2-9872-d2f90a8f0971 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:27.074420 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-bfb0aa4e-e897-40d2-9872-d2f90a8f0971 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:27.213326 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-bfb0aa4e-e897-40d2-9872-d2f90a8f0971 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:10:27.222814 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-bfb0aa4e-e897-40d2-9872-d2f90a8f0971 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/b8a810a4-60df-4062-baae-8f11e0615a49" status: 200 len: 1301 microversion: 2.1 time: 0.163462 Jun 07 22:10:27.223509 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 488/982] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:10:27 2022] GET /compute/v2.1/servers/b8a810a4-60df-4062-baae-8f11e0615a49 => generated 1301 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:10:28.242293 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-f4a55cee-5f1b-4ee9-aa3d-855ed29f14ce tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:28.243005 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-f4a55cee-5f1b-4ee9-aa3d-855ed29f14ce tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: b8a810a4-60df-4062-baae-8f11e0615a49] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:28.250644 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-f4a55cee-5f1b-4ee9-aa3d-855ed29f14ce tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:28.251458 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-f4a55cee-5f1b-4ee9-aa3d-855ed29f14ce tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:28.252260 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-f4a55cee-5f1b-4ee9-aa3d-855ed29f14ce tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:28.252709 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-f4a55cee-5f1b-4ee9-aa3d-855ed29f14ce tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:28.394168 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-f4a55cee-5f1b-4ee9-aa3d-855ed29f14ce tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:10:28.403084 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-f4a55cee-5f1b-4ee9-aa3d-855ed29f14ce tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/b8a810a4-60df-4062-baae-8f11e0615a49" status: 200 len: 1367 microversion: 2.1 time: 0.165592 Jun 07 22:10:28.410566 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 495/983] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:10:28 2022] GET /compute/v2.1/servers/b8a810a4-60df-4062-baae-8f11e0615a49 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:10:28.902289 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [req-1526abf3-ed6d-4411-a45e-81b91ef8fcbb req-b8eee707-9d09-4f18-8533-ac4e539c5fe7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8a810a4-60df-4062-baae-8f11e0615a49", "tag": "8024526f-033a-4156-9ee3-19096f0790de"}]} {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:10:28.913002 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [req-1526abf3-ed6d-4411-a45e-81b91ef8fcbb req-b8eee707-9d09-4f18-8533-ac4e539c5fe7 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:28.913915 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [req-1526abf3-ed6d-4411-a45e-81b91ef8fcbb req-b8eee707-9d09-4f18-8533-ac4e539c5fe7 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:28.936331 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.compute.server_external_events [req-1526abf3-ed6d-4411-a45e-81b91ef8fcbb req-b8eee707-9d09-4f18-8533-ac4e539c5fe7 service nova] Creating event network-changed:8024526f-033a-4156-9ee3-19096f0790de for instance b8a810a4-60df-4062-baae-8f11e0615a49 on hv-cinder-83552 Jun 07 22:10:28.951405 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [req-1526abf3-ed6d-4411-a45e-81b91ef8fcbb req-b8eee707-9d09-4f18-8533-ac4e539c5fe7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053042 Jun 07 22:10:28.952584 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 489/984] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:10:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 22:10:29.422159 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-557cb094-3c5c-4669-ab8f-76d05601ea75 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:29.422931 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-557cb094-3c5c-4669-ab8f-76d05601ea75 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: b8a810a4-60df-4062-baae-8f11e0615a49] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:29.429532 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-557cb094-3c5c-4669-ab8f-76d05601ea75 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:29.429982 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-557cb094-3c5c-4669-ab8f-76d05601ea75 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:29.430775 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-557cb094-3c5c-4669-ab8f-76d05601ea75 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:29.431434 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-557cb094-3c5c-4669-ab8f-76d05601ea75 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:29.561623 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-557cb094-3c5c-4669-ab8f-76d05601ea75 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:10:29.569005 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-557cb094-3c5c-4669-ab8f-76d05601ea75 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/b8a810a4-60df-4062-baae-8f11e0615a49" status: 200 len: 1367 microversion: 2.1 time: 0.151619 Jun 07 22:10:29.569566 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 496/985] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:10:29 2022] GET /compute/v2.1/servers/b8a810a4-60df-4062-baae-8f11e0615a49 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:10:30.588108 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-6377ed04-16a7-4760-8a31-75afd51e387a tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:30.588811 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-6377ed04-16a7-4760-8a31-75afd51e387a tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: b8a810a4-60df-4062-baae-8f11e0615a49] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:30.595664 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6377ed04-16a7-4760-8a31-75afd51e387a tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:30.596114 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6377ed04-16a7-4760-8a31-75afd51e387a tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:30.596870 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6377ed04-16a7-4760-8a31-75afd51e387a tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:30.597314 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6377ed04-16a7-4760-8a31-75afd51e387a tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:30.728620 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-6377ed04-16a7-4760-8a31-75afd51e387a tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:10:30.736923 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-6377ed04-16a7-4760-8a31-75afd51e387a tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/b8a810a4-60df-4062-baae-8f11e0615a49" status: 200 len: 1367 microversion: 2.1 time: 0.154659 Jun 07 22:10:30.737486 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 490/986] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:10:30 2022] GET /compute/v2.1/servers/b8a810a4-60df-4062-baae-8f11e0615a49 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:10:30.855581 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-4a3f5971-b371-42e7-90f7-e66d5fb734e5 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:30.856066 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-4a3f5971-b371-42e7-90f7-e66d5fb734e5 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: c2ece8dd-91fb-472c-b0c7-970ee215412f] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:30.863931 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-4a3f5971-b371-42e7-90f7-e66d5fb734e5 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:30.864377 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-4a3f5971-b371-42e7-90f7-e66d5fb734e5 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:30.865128 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-4a3f5971-b371-42e7-90f7-e66d5fb734e5 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:30.865558 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-4a3f5971-b371-42e7-90f7-e66d5fb734e5 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:30.889759 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-4a3f5971-b371-42e7-90f7-e66d5fb734e5 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: c2ece8dd-91fb-472c-b0c7-970ee215412f] Going to try to terminate instance {{(pid=117971) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 22:10:30.960870 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-4a3f5971-b371-42e7-90f7-e66d5fb734e5 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "DELETE /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f" status: 204 len: 0 microversion: 2.1 time: 0.109346 Jun 07 22:10:30.961437 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 497/987] 10.222.0.13 () {58 vars in 1238 bytes} [Tue Jun 7 22:10:30 2022] DELETE /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 22:10:30.969916 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-05eb3cd5-cefb-4104-8209-efa7042a5a1a tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:30.970519 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-05eb3cd5-cefb-4104-8209-efa7042a5a1a tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: c2ece8dd-91fb-472c-b0c7-970ee215412f] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:30.976440 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-05eb3cd5-cefb-4104-8209-efa7042a5a1a tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:30.977134 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-05eb3cd5-cefb-4104-8209-efa7042a5a1a tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:30.977873 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-05eb3cd5-cefb-4104-8209-efa7042a5a1a tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:30.978309 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-05eb3cd5-cefb-4104-8209-efa7042a5a1a tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:31.106321 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-05eb3cd5-cefb-4104-8209-efa7042a5a1a tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:10:31.114177 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-05eb3cd5-cefb-4104-8209-efa7042a5a1a tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f" status: 200 len: 1577 microversion: 2.1 time: 0.148656 Jun 07 22:10:31.114747 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 491/988] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:10:30 2022] GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f => generated 1577 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:10:31.754387 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-8a1f7b17-8118-4c33-a88b-fac583aca4b7 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:31.755100 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-8a1f7b17-8118-4c33-a88b-fac583aca4b7 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: b8a810a4-60df-4062-baae-8f11e0615a49] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:31.761471 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-8a1f7b17-8118-4c33-a88b-fac583aca4b7 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:31.761922 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-8a1f7b17-8118-4c33-a88b-fac583aca4b7 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:31.763475 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-8a1f7b17-8118-4c33-a88b-fac583aca4b7 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:31.763753 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-8a1f7b17-8118-4c33-a88b-fac583aca4b7 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:31.899640 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-8a1f7b17-8118-4c33-a88b-fac583aca4b7 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:10:31.907737 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-8a1f7b17-8118-4c33-a88b-fac583aca4b7 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/b8a810a4-60df-4062-baae-8f11e0615a49" status: 200 len: 1367 microversion: 2.1 time: 0.157562 Jun 07 22:10:31.908288 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 498/989] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:10:31 2022] GET /compute/v2.1/servers/b8a810a4-60df-4062-baae-8f11e0615a49 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:10:32.132002 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-d03f9638-ad83-4f14-8c32-6c8049a47244 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:32.132614 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-d03f9638-ad83-4f14-8c32-6c8049a47244 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: c2ece8dd-91fb-472c-b0c7-970ee215412f] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:32.139985 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d03f9638-ad83-4f14-8c32-6c8049a47244 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:32.140434 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d03f9638-ad83-4f14-8c32-6c8049a47244 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:32.141200 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d03f9638-ad83-4f14-8c32-6c8049a47244 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:32.141641 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d03f9638-ad83-4f14-8c32-6c8049a47244 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:32.273229 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-d03f9638-ad83-4f14-8c32-6c8049a47244 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:10:32.280959 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-d03f9638-ad83-4f14-8c32-6c8049a47244 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f" status: 200 len: 1577 microversion: 2.1 time: 0.153331 Jun 07 22:10:32.281528 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 492/990] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:10:32 2022] GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:10:32.925152 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-cccece50-9581-4fec-bd79-f202201d6a01 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:32.925765 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-cccece50-9581-4fec-bd79-f202201d6a01 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: b8a810a4-60df-4062-baae-8f11e0615a49] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:32.932342 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-cccece50-9581-4fec-bd79-f202201d6a01 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:32.932792 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-cccece50-9581-4fec-bd79-f202201d6a01 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:32.933547 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-cccece50-9581-4fec-bd79-f202201d6a01 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:32.934010 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-cccece50-9581-4fec-bd79-f202201d6a01 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:33.065763 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-cccece50-9581-4fec-bd79-f202201d6a01 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:10:33.068508 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:10:33.076587 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-cccece50-9581-4fec-bd79-f202201d6a01 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/b8a810a4-60df-4062-baae-8f11e0615a49" status: 200 len: 1367 microversion: 2.1 time: 0.155242 Jun 07 22:10:33.077395 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 499/991] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:10:32 2022] GET /compute/v2.1/servers/b8a810a4-60df-4062-baae-8f11e0615a49 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:10:33.297420 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-b06093e4-867f-4637-8145-2c9a0b9c26a2 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:33.298100 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-b06093e4-867f-4637-8145-2c9a0b9c26a2 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: c2ece8dd-91fb-472c-b0c7-970ee215412f] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:33.304707 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-b06093e4-867f-4637-8145-2c9a0b9c26a2 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:33.305151 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-b06093e4-867f-4637-8145-2c9a0b9c26a2 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:33.305947 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-b06093e4-867f-4637-8145-2c9a0b9c26a2 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:33.306378 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-b06093e4-867f-4637-8145-2c9a0b9c26a2 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:33.449853 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-b06093e4-867f-4637-8145-2c9a0b9c26a2 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:10:33.457463 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-b06093e4-867f-4637-8145-2c9a0b9c26a2 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f" status: 200 len: 1577 microversion: 2.1 time: 0.163860 Jun 07 22:10:33.458040 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 493/992] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:10:33 2022] GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f => generated 1577 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:10:34.094545 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-aacc352e-e56a-4cee-8eeb-a332b4c687b0 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:34.095268 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-aacc352e-e56a-4cee-8eeb-a332b4c687b0 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: b8a810a4-60df-4062-baae-8f11e0615a49] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:34.102923 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-aacc352e-e56a-4cee-8eeb-a332b4c687b0 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:34.103397 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-aacc352e-e56a-4cee-8eeb-a332b4c687b0 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:34.104162 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-aacc352e-e56a-4cee-8eeb-a332b4c687b0 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:34.104595 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-aacc352e-e56a-4cee-8eeb-a332b4c687b0 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:34.244285 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-aacc352e-e56a-4cee-8eeb-a332b4c687b0 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:10:34.252301 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-aacc352e-e56a-4cee-8eeb-a332b4c687b0 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/b8a810a4-60df-4062-baae-8f11e0615a49" status: 200 len: 1367 microversion: 2.1 time: 0.162615 Jun 07 22:10:34.252861 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 500/993] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:10:34 2022] GET /compute/v2.1/servers/b8a810a4-60df-4062-baae-8f11e0615a49 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:10:34.475715 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-56c185a3-fd20-4228-872f-9f0c916a96cc tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:34.476434 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-56c185a3-fd20-4228-872f-9f0c916a96cc tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: c2ece8dd-91fb-472c-b0c7-970ee215412f] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:34.484110 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-56c185a3-fd20-4228-872f-9f0c916a96cc tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:34.484547 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-56c185a3-fd20-4228-872f-9f0c916a96cc tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:34.485310 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-56c185a3-fd20-4228-872f-9f0c916a96cc tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:34.485738 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-56c185a3-fd20-4228-872f-9f0c916a96cc tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:34.829412 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-56c185a3-fd20-4228-872f-9f0c916a96cc tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:10:34.838546 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-56c185a3-fd20-4228-872f-9f0c916a96cc tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f" status: 200 len: 1577 microversion: 2.1 time: 0.366852 Jun 07 22:10:34.848919 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 494/994] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:10:34 2022] GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f => generated 1577 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:10:35.097670 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [req-5d87789a-f142-4d05-86d8-751e37d042f5 req-931e3c5a-120a-4bff-80c3-96b42b9b175b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2ece8dd-91fb-472c-b0c7-970ee215412f", "name": "network-vif-deleted", "tag": "cd305cc0-e94a-48c1-a7dc-703d1a53df17"}]} {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:10:35.108845 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-5d87789a-f142-4d05-86d8-751e37d042f5 req-931e3c5a-120a-4bff-80c3-96b42b9b175b service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:35.109735 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-5d87789a-f142-4d05-86d8-751e37d042f5 req-931e3c5a-120a-4bff-80c3-96b42b9b175b service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:35.122912 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.compute.server_external_events [req-5d87789a-f142-4d05-86d8-751e37d042f5 req-931e3c5a-120a-4bff-80c3-96b42b9b175b service nova] Creating event network-vif-deleted:cd305cc0-e94a-48c1-a7dc-703d1a53df17 for instance c2ece8dd-91fb-472c-b0c7-970ee215412f on hv-cinder-83552 Jun 07 22:10:35.128225 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [req-5d87789a-f142-4d05-86d8-751e37d042f5 req-931e3c5a-120a-4bff-80c3-96b42b9b175b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033980 Jun 07 22:10:35.129233 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 501/995] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:10:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 22:10:35.269860 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-773ba0b1-e0fd-4651-99e2-d259367b972a tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:35.270854 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-773ba0b1-e0fd-4651-99e2-d259367b972a tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: b8a810a4-60df-4062-baae-8f11e0615a49] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:35.277791 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-773ba0b1-e0fd-4651-99e2-d259367b972a tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:35.278888 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-773ba0b1-e0fd-4651-99e2-d259367b972a tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:35.279764 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-773ba0b1-e0fd-4651-99e2-d259367b972a tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:35.280578 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-773ba0b1-e0fd-4651-99e2-d259367b972a tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:35.417027 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-773ba0b1-e0fd-4651-99e2-d259367b972a tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:10:35.425517 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-773ba0b1-e0fd-4651-99e2-d259367b972a tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/b8a810a4-60df-4062-baae-8f11e0615a49" status: 200 len: 1367 microversion: 2.1 time: 0.159604 Jun 07 22:10:35.426322 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 495/996] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:10:35 2022] GET /compute/v2.1/servers/b8a810a4-60df-4062-baae-8f11e0615a49 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:10:35.573050 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [req-c9f99ddb-70fe-40a3-b344-3f666af0a90a req-b6defd5f-d9e3-48a1-942f-bf36c8a23321 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8a810a4-60df-4062-baae-8f11e0615a49", "name": "network-vif-plugged", "status": "completed", "tag": "8024526f-033a-4156-9ee3-19096f0790de"}]} {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:10:35.583293 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-c9f99ddb-70fe-40a3-b344-3f666af0a90a req-b6defd5f-d9e3-48a1-942f-bf36c8a23321 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:35.583767 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-c9f99ddb-70fe-40a3-b344-3f666af0a90a req-b6defd5f-d9e3-48a1-942f-bf36c8a23321 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:35.596167 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.compute.server_external_events [req-c9f99ddb-70fe-40a3-b344-3f666af0a90a req-b6defd5f-d9e3-48a1-942f-bf36c8a23321 service nova] Creating event network-vif-plugged:8024526f-033a-4156-9ee3-19096f0790de for instance b8a810a4-60df-4062-baae-8f11e0615a49 on hv-cinder-83552 Jun 07 22:10:35.602751 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [req-c9f99ddb-70fe-40a3-b344-3f666af0a90a req-b6defd5f-d9e3-48a1-942f-bf36c8a23321 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037647 Jun 07 22:10:35.603365 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 502/997] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:10:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:10:35.857088 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-6375f58d-98ce-42e5-b934-9d18f2cd29c2 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:35.857784 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-6375f58d-98ce-42e5-b934-9d18f2cd29c2 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: c2ece8dd-91fb-472c-b0c7-970ee215412f] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:35.864499 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6375f58d-98ce-42e5-b934-9d18f2cd29c2 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:35.864949 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6375f58d-98ce-42e5-b934-9d18f2cd29c2 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:35.865706 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6375f58d-98ce-42e5-b934-9d18f2cd29c2 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:35.866143 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6375f58d-98ce-42e5-b934-9d18f2cd29c2 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:35.899782 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6375f58d-98ce-42e5-b934-9d18f2cd29c2 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:35.900233 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6375f58d-98ce-42e5-b934-9d18f2cd29c2 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:35.900710 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.objects.instance [None req-6375f58d-98ce-42e5-b934-9d18f2cd29c2 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lazy-loading 'fault' on Instance uuid c2ece8dd-91fb-472c-b0c7-970ee215412f {{(pid=117970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 22:10:35.944365 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-6375f58d-98ce-42e5-b934-9d18f2cd29c2 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:10:35.952453 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-6375f58d-98ce-42e5-b934-9d18f2cd29c2 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f" status: 200 len: 1231 microversion: 2.1 time: 0.099634 Jun 07 22:10:35.953034 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 496/998] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:10:35 2022] GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f => generated 1231 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:10:36.439425 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_cell0:SELECT=2 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:10:36.440224 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_cell0:SELECT=6 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:10:36.444750 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-de650add-2743-4aad-b1b4-0b18405e3c1e tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:36.445446 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-de650add-2743-4aad-b1b4-0b18405e3c1e tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: b8a810a4-60df-4062-baae-8f11e0615a49] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:36.453381 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-de650add-2743-4aad-b1b4-0b18405e3c1e tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:36.453839 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-de650add-2743-4aad-b1b4-0b18405e3c1e tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:36.454652 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-de650add-2743-4aad-b1b4-0b18405e3c1e tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:36.455115 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-de650add-2743-4aad-b1b4-0b18405e3c1e tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:36.591548 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-de650add-2743-4aad-b1b4-0b18405e3c1e tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:10:36.599028 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-de650add-2743-4aad-b1b4-0b18405e3c1e tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/b8a810a4-60df-4062-baae-8f11e0615a49" status: 200 len: 1367 microversion: 2.1 time: 0.160646 Jun 07 22:10:36.599585 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 503/999] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:10:36 2022] GET /compute/v2.1/servers/b8a810a4-60df-4062-baae-8f11e0615a49 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:10:36.970208 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-738f7dbb-3ada-42ab-95a0-e688687dd034 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:36.970818 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-738f7dbb-3ada-42ab-95a0-e688687dd034 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: c2ece8dd-91fb-472c-b0c7-970ee215412f] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:36.972745 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_cell0:SELECT=6 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:10:36.978570 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-738f7dbb-3ada-42ab-95a0-e688687dd034 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:36.979020 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-738f7dbb-3ada-42ab-95a0-e688687dd034 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:36.979807 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-738f7dbb-3ada-42ab-95a0-e688687dd034 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:36.980245 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-738f7dbb-3ada-42ab-95a0-e688687dd034 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:36.993334 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.wsgi [None req-738f7dbb-3ada-42ab-95a0-e688687dd034 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] HTTP exception thrown: Instance c2ece8dd-91fb-472c-b0c7-970ee215412f could not be found. Jun 07 22:10:36.994938 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-738f7dbb-3ada-42ab-95a0-e688687dd034 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Request method failure captured: Jun 07 22:10:36.994938 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: request: GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f HTTP/1.1 Jun 07 22:10:36.994938 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Accept: application/json Jun 07 22:10:36.994938 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Accept-Encoding: identity Jun 07 22:10:36.994938 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Connection: close Jun 07 22:10:36.994938 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Content-Length: 0 Jun 07 22:10:36.994938 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Content-Type: application/json Jun 07 22:10:36.994938 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Host: 10.222.0.13 Jun 07 22:10:36.994938 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Openstack-System-Scope: None Jun 07 22:10:36.994938 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: User-Agent: python-urllib3/1.26.9 Jun 07 22:10:36.994938 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Auth-Token: gAAAAABin8u7qV85QKMdZKEe68GTjOJU9FFkwnwtG9SoiStsWqE7tDV8Tgx2pD5P95pHCpHANsdmGAnP7iJJpJ0SRM1bjoXdoVBCoXPWcYIXFc_nRMhsmaZLxlygUaCFgJ8n5R4eNEIV6vagbhNNf0OFI7I302r61QvTwj7JImQ0_IwF5QhBUH8 Jun 07 22:10:36.994938 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Domain-Id: None Jun 07 22:10:36.994938 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Domain-Name: None Jun 07 22:10:36.994938 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Identity-Status: Confirmed Jun 07 22:10:36.994938 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Is-Admin-Project: True Jun 07 22:10:36.994938 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Domain-Id: default Jun 07 22:10:36.994938 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Domain-Name: Default Jun 07 22:10:36.994938 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Id: 579eb78d8af74e2cadce3a0c793b4440 Jun 07 22:10:36.994938 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Name: tempest-TestVolumeBootPattern-843087113 Jun 07 22:10:36.994938 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Role: member,reader Jun 07 22:10:36.994938 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Roles: member,reader Jun 07 22:10:36.996522 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/579eb78d8af74e2cadce3a0c793b4440"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_579eb78d8af74e2cadce3a0c793b4440"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/579eb78d8af74e2cadce3a0c793b4440"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/579eb78d8af74e2cadce3a0c793b4440"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}] Jun 07 22:10:36.996522 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Tenant: tempest-TestVolumeBootPattern-843087113 Jun 07 22:10:36.996522 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Tenant-Id: 579eb78d8af74e2cadce3a0c793b4440 Jun 07 22:10:36.996522 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Tenant-Name: tempest-TestVolumeBootPattern-843087113 Jun 07 22:10:36.996522 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User: tempest-TestVolumeBootPattern-843087113-project Jun 07 22:10:36.996522 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Domain-Id: default Jun 07 22:10:36.996522 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Domain-Name: Default Jun 07 22:10:36.996522 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Id: c710942802df49ec8bd630e4b225eed2 Jun 07 22:10:36.996522 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Name: tempest-TestVolumeBootPattern-843087113-project Jun 07 22:10:36.996522 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: method: > Jun 07 22:10:36.996522 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: exception: Instance c2ece8dd-91fb-472c-b0c7-970ee215412f could not be found. Jun 07 22:10:36.996522 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: action_args: {'id': 'c2ece8dd-91fb-472c-b0c7-970ee215412f'} Jun 07 22:10:36.997551 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 22:10:36.997551 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:10:36.997551 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 22:10:36.997551 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 22:10:36.997551 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 22:10:36.997551 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 22:10:36.997551 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 22:10:36.997551 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 22:10:36.997551 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 22:10:36.997551 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 22:10:36.997551 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2ece8dd-91fb-472c-b0c7-970ee215412f could not be found. Jun 07 22:10:36.997551 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:10:36.997551 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:10:36.997551 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:10:36.997551 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:10:36.997551 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:10:36.997551 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:10:36.997551 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 22:10:36.997551 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 22:10:36.997551 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 22:10:36.999017 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 22:10:36.999017 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 22:10:36.999017 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 22:10:36.999017 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 22:10:36.999017 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 22:10:36.999017 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 22:10:36.999017 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 22:10:36.999017 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2ece8dd-91fb-472c-b0c7-970ee215412f could not be found. Jun 07 22:10:36.999017 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:10:36.999017 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:10:36.999017 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:10:36.999017 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:10:36.999017 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:10:36.999017 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:10:36.999017 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 22:10:36.999017 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 22:10:36.999017 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2ece8dd-91fb-472c-b0c7-970ee215412f could not be found. Jun 07 22:10:36.999017 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:10:37.000480 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-738f7dbb-3ada-42ab-95a0-e688687dd034 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Returning 404 to user: Instance c2ece8dd-91fb-472c-b0c7-970ee215412f could not be found. {{(pid=117970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 22:10:37.000480 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-738f7dbb-3ada-42ab-95a0-e688687dd034 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f" status: 404 len: 111 microversion: 2.1 time: 0.030586 Jun 07 22:10:37.000480 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 497/1000] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:10:36 2022] GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 22:10:37.090560 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-14241fd2-defa-4018-869b-9e5ac4f0fc86 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-545987815", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1489617035", "security_groups": [{"name": "tempest-secgroup-smoke-1229564476"}], "block_device_mapping_v2": [{"uuid": "7ea35f9d-cc53-4afb-a9a1-bc965739f562", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "63aac617-2d3a-4d8b-b894-a27820a7e5e2"}]}} {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:10:37.201199 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.network.neutron [None req-14241fd2-defa-4018-869b-9e5ac4f0fc86 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] validate_networks() for [('63aac617-2d3a-4d8b-b894-a27820a7e5e2', None, None, None, None, None)] {{(pid=117971) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 22:10:37.564108 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.virt.hardware [None req-14241fd2-defa-4018-869b-9e5ac4f0fc86 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Flavor limits 0:0:0 {{(pid=117971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 22:10:37.564614 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.virt.hardware [None req-14241fd2-defa-4018-869b-9e5ac4f0fc86 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Image limits 0:0:0 {{(pid=117971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 22:10:37.565014 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.virt.hardware [None req-14241fd2-defa-4018-869b-9e5ac4f0fc86 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Flavor pref 0:0:0 {{(pid=117971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 22:10:37.565415 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.virt.hardware [None req-14241fd2-defa-4018-869b-9e5ac4f0fc86 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Image pref 0:0:0 {{(pid=117971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 22:10:37.565818 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.virt.hardware [None req-14241fd2-defa-4018-869b-9e5ac4f0fc86 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 22:10:37.575653 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-14241fd2-defa-4018-869b-9e5ac4f0fc86 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:37.576104 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-14241fd2-defa-4018-869b-9e5ac4f0fc86 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:37.576886 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-14241fd2-defa-4018-869b-9e5ac4f0fc86 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:37.577320 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-14241fd2-defa-4018-869b-9e5ac4f0fc86 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:37.594703 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.quota [None req-14241fd2-defa-4018-869b-9e5ac4f0fc86 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Getting quotas for project 579eb78d8af74e2cadce3a0c793b4440. Resources: {'cores', 'ram', 'instances'} {{(pid=117971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 22:10:37.598577 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.quota [None req-14241fd2-defa-4018-869b-9e5ac4f0fc86 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Getting quotas for user c710942802df49ec8bd630e4b225eed2 and project 579eb78d8af74e2cadce3a0c793b4440. Resources: {'cores', 'ram', 'instances'} {{(pid=117971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 22:10:37.616906 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-3ebabea2-6ae2-4d19-aa07-4922f480a877 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:37.617515 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-3ebabea2-6ae2-4d19-aa07-4922f480a877 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: b8a810a4-60df-4062-baae-8f11e0615a49] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:37.624492 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-3ebabea2-6ae2-4d19-aa07-4922f480a877 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:37.624941 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-3ebabea2-6ae2-4d19-aa07-4922f480a877 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:37.625703 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-3ebabea2-6ae2-4d19-aa07-4922f480a877 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:37.626134 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-3ebabea2-6ae2-4d19-aa07-4922f480a877 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:37.656836 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-14241fd2-defa-4018-869b-9e5ac4f0fc86 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Going to run 1 instances... {{(pid=117971) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 22:10:37.658926 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-14241fd2-defa-4018-869b-9e5ac4f0fc86 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: 454d121a-d51a-4a5e-9c68-6280d2c6a1b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7ea35f9d-cc53-4afb-a9a1-bc965739f562',volume_size=None,volume_type=None)] {{(pid=117971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 22:10:37.797399 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-3ebabea2-6ae2-4d19-aa07-4922f480a877 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:10:37.805232 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-3ebabea2-6ae2-4d19-aa07-4922f480a877 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/b8a810a4-60df-4062-baae-8f11e0615a49" status: 200 len: 1367 microversion: 2.1 time: 0.192261 Jun 07 22:10:37.805793 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 498/1001] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:10:37 2022] GET /compute/v2.1/servers/b8a810a4-60df-4062-baae-8f11e0615a49 => generated 1367 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:10:37.815967 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-14241fd2-defa-4018-869b-9e5ac4f0fc86 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.729292 Jun 07 22:10:37.816538 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 504/1002] 10.222.0.13 () {60 vars in 1146 bytes} [Tue Jun 7 22:10:37 2022] POST /compute/v2.1/servers => generated 406 bytes in 731 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 22:10:37.826946 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-522e45bc-fc69-4184-ba80-de0677553ed3 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:37.827578 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-522e45bc-fc69-4184-ba80-de0677553ed3 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: 454d121a-d51a-4a5e-9c68-6280d2c6a1b2] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:37.882913 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-522e45bc-fc69-4184-ba80-de0677553ed3 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:10:37.889684 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-522e45bc-fc69-4184-ba80-de0677553ed3 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/454d121a-d51a-4a5e-9c68-6280d2c6a1b2" status: 200 len: 1094 microversion: 2.1 time: 0.067077 Jun 07 22:10:37.890271 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 499/1003] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:10:37 2022] GET /compute/v2.1/servers/454d121a-d51a-4a5e-9c68-6280d2c6a1b2 => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:10:38.823564 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-cab60247-f616-4355-8362-018fe1991187 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:38.824177 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-cab60247-f616-4355-8362-018fe1991187 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: b8a810a4-60df-4062-baae-8f11e0615a49] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:38.831769 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-cab60247-f616-4355-8362-018fe1991187 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:38.832215 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-cab60247-f616-4355-8362-018fe1991187 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:38.833001 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-cab60247-f616-4355-8362-018fe1991187 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:38.833432 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-cab60247-f616-4355-8362-018fe1991187 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:38.908534 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-0f0c92b6-dca5-49c8-8055-fe7bb43b1c18 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:38.909136 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-0f0c92b6-dca5-49c8-8055-fe7bb43b1c18 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: 454d121a-d51a-4a5e-9c68-6280d2c6a1b2] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:38.916879 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0f0c92b6-dca5-49c8-8055-fe7bb43b1c18 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:38.917551 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0f0c92b6-dca5-49c8-8055-fe7bb43b1c18 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:38.918500 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0f0c92b6-dca5-49c8-8055-fe7bb43b1c18 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:38.919372 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0f0c92b6-dca5-49c8-8055-fe7bb43b1c18 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:38.974651 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-cab60247-f616-4355-8362-018fe1991187 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:10:38.983362 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-cab60247-f616-4355-8362-018fe1991187 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/b8a810a4-60df-4062-baae-8f11e0615a49" status: 200 len: 1557 microversion: 2.1 time: 0.164206 Jun 07 22:10:38.984059 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 505/1004] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:10:38 2022] GET /compute/v2.1/servers/b8a810a4-60df-4062-baae-8f11e0615a49 => generated 1557 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:10:38.995994 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-0f0c92b6-dca5-49c8-8055-fe7bb43b1c18 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:10:39.000852 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-eb16b807-85a5-4651-a5e0-ccdbc7415d83 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:39.001814 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-eb16b807-85a5-4651-a5e0-ccdbc7415d83 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: b8a810a4-60df-4062-baae-8f11e0615a49] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:39.008226 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-0f0c92b6-dca5-49c8-8055-fe7bb43b1c18 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/454d121a-d51a-4a5e-9c68-6280d2c6a1b2" status: 200 len: 1192 microversion: 2.1 time: 0.104671 Jun 07 22:10:39.009363 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 500/1005] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:10:38 2022] GET /compute/v2.1/servers/454d121a-d51a-4a5e-9c68-6280d2c6a1b2 => generated 1192 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:10:39.010848 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-eb16b807-85a5-4651-a5e0-ccdbc7415d83 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:39.011708 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-eb16b807-85a5-4651-a5e0-ccdbc7415d83 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:39.013480 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-eb16b807-85a5-4651-a5e0-ccdbc7415d83 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:39.014131 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-eb16b807-85a5-4651-a5e0-ccdbc7415d83 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:39.098210 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-eb16b807-85a5-4651-a5e0-ccdbc7415d83 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/b8a810a4-60df-4062-baae-8f11e0615a49/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102019 Jun 07 22:10:39.098805 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 506/1006] 10.222.0.13 () {58 vars in 1274 bytes} [Tue Jun 7 22:10:38 2022] GET /compute/v2.1/servers/b8a810a4-60df-4062-baae-8f11e0615a49/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 22:10:40.025972 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-028ae103-85b8-4d44-848a-995c8e296db9 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:40.026605 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-028ae103-85b8-4d44-848a-995c8e296db9 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: 454d121a-d51a-4a5e-9c68-6280d2c6a1b2] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:40.033961 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-028ae103-85b8-4d44-848a-995c8e296db9 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:40.034437 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-028ae103-85b8-4d44-848a-995c8e296db9 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:40.035193 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-028ae103-85b8-4d44-848a-995c8e296db9 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:40.035648 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-028ae103-85b8-4d44-848a-995c8e296db9 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:40.143430 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-028ae103-85b8-4d44-848a-995c8e296db9 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:10:40.150780 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-028ae103-85b8-4d44-848a-995c8e296db9 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/454d121a-d51a-4a5e-9c68-6280d2c6a1b2" status: 200 len: 1198 microversion: 2.1 time: 0.128708 Jun 07 22:10:40.151372 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 501/1007] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:10:40 2022] GET /compute/v2.1/servers/454d121a-d51a-4a5e-9c68-6280d2c6a1b2 => generated 1198 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:10:40.856940 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [req-ba938da6-d52f-40ef-80e0-426e8043f6cf req-b972dcf1-2070-4149-903c-aaef5cff2a8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8a810a4-60df-4062-baae-8f11e0615a49", "tag": "8024526f-033a-4156-9ee3-19096f0790de"}]} {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:10:40.866882 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-ba938da6-d52f-40ef-80e0-426e8043f6cf req-b972dcf1-2070-4149-903c-aaef5cff2a8c service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:40.867666 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-ba938da6-d52f-40ef-80e0-426e8043f6cf req-b972dcf1-2070-4149-903c-aaef5cff2a8c service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:40.879822 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.compute.server_external_events [req-ba938da6-d52f-40ef-80e0-426e8043f6cf req-b972dcf1-2070-4149-903c-aaef5cff2a8c service nova] Creating event network-changed:8024526f-033a-4156-9ee3-19096f0790de for instance b8a810a4-60df-4062-baae-8f11e0615a49 on hv-cinder-83552 Jun 07 22:10:40.884771 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [req-ba938da6-d52f-40ef-80e0-426e8043f6cf req-b972dcf1-2070-4149-903c-aaef5cff2a8c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033170 Jun 07 22:10:40.885566 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 507/1008] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:10:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:10:41.168140 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-89236707-eeb2-44df-9d6b-d13a6366a60b tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:41.169506 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-89236707-eeb2-44df-9d6b-d13a6366a60b tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: 454d121a-d51a-4a5e-9c68-6280d2c6a1b2] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:41.175801 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-89236707-eeb2-44df-9d6b-d13a6366a60b tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:41.176252 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-89236707-eeb2-44df-9d6b-d13a6366a60b tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:41.177019 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-89236707-eeb2-44df-9d6b-d13a6366a60b tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:41.177482 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-89236707-eeb2-44df-9d6b-d13a6366a60b tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:41.181908 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_cell1:SELECT=100 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:10:41.519137 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-89236707-eeb2-44df-9d6b-d13a6366a60b tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:10:41.534345 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-89236707-eeb2-44df-9d6b-d13a6366a60b tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/454d121a-d51a-4a5e-9c68-6280d2c6a1b2" status: 200 len: 1266 microversion: 2.1 time: 0.369768 Jun 07 22:10:41.546513 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 502/1009] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:10:41 2022] GET /compute/v2.1/servers/454d121a-d51a-4a5e-9c68-6280d2c6a1b2 => generated 1266 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:10:42.552537 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-26eafc3a-74aa-4827-b2e4-4baac1b2e8b5 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:42.553258 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-26eafc3a-74aa-4827-b2e4-4baac1b2e8b5 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: 454d121a-d51a-4a5e-9c68-6280d2c6a1b2] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:42.560950 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-26eafc3a-74aa-4827-b2e4-4baac1b2e8b5 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:42.561399 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-26eafc3a-74aa-4827-b2e4-4baac1b2e8b5 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:42.562152 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-26eafc3a-74aa-4827-b2e4-4baac1b2e8b5 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:42.562584 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-26eafc3a-74aa-4827-b2e4-4baac1b2e8b5 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:42.698820 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-26eafc3a-74aa-4827-b2e4-4baac1b2e8b5 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:10:42.706691 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-26eafc3a-74aa-4827-b2e4-4baac1b2e8b5 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/454d121a-d51a-4a5e-9c68-6280d2c6a1b2" status: 200 len: 1266 microversion: 2.1 time: 0.158234 Jun 07 22:10:42.707248 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 508/1010] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:10:42 2022] GET /compute/v2.1/servers/454d121a-d51a-4a5e-9c68-6280d2c6a1b2 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:10:42.901064 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [req-02ba8b6c-3ae9-4d4b-9169-3cd4f1a1afa5 req-b188bf42-3a8b-4256-868a-2255b340bb07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "454d121a-d51a-4a5e-9c68-6280d2c6a1b2", "tag": "578443e3-4c7f-498f-897f-5639fda8f902"}]} {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:10:42.910589 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [req-02ba8b6c-3ae9-4d4b-9169-3cd4f1a1afa5 req-b188bf42-3a8b-4256-868a-2255b340bb07 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:42.911037 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [req-02ba8b6c-3ae9-4d4b-9169-3cd4f1a1afa5 req-b188bf42-3a8b-4256-868a-2255b340bb07 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:42.922765 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.compute.server_external_events [req-02ba8b6c-3ae9-4d4b-9169-3cd4f1a1afa5 req-b188bf42-3a8b-4256-868a-2255b340bb07 service nova] Creating event network-changed:578443e3-4c7f-498f-897f-5639fda8f902 for instance 454d121a-d51a-4a5e-9c68-6280d2c6a1b2 on hv-cinder-83552 Jun 07 22:10:42.927870 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [req-02ba8b6c-3ae9-4d4b-9169-3cd4f1a1afa5 req-b188bf42-3a8b-4256-868a-2255b340bb07 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030400 Jun 07 22:10:42.928440 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 503/1011] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:10:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:10:43.726020 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-7b0b529f-a9ad-4675-8e18-dcf9c7ad9f85 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:43.726572 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-7b0b529f-a9ad-4675-8e18-dcf9c7ad9f85 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: 454d121a-d51a-4a5e-9c68-6280d2c6a1b2] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:43.734337 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-7b0b529f-a9ad-4675-8e18-dcf9c7ad9f85 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:43.734787 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-7b0b529f-a9ad-4675-8e18-dcf9c7ad9f85 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:43.735593 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-7b0b529f-a9ad-4675-8e18-dcf9c7ad9f85 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:43.736022 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-7b0b529f-a9ad-4675-8e18-dcf9c7ad9f85 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:43.867672 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-7b0b529f-a9ad-4675-8e18-dcf9c7ad9f85 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:10:43.876377 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-7b0b529f-a9ad-4675-8e18-dcf9c7ad9f85 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/454d121a-d51a-4a5e-9c68-6280d2c6a1b2" status: 200 len: 1266 microversion: 2.1 time: 0.154269 Jun 07 22:10:43.877030 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 509/1012] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:10:43 2022] GET /compute/v2.1/servers/454d121a-d51a-4a5e-9c68-6280d2c6a1b2 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:10:44.893067 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-c560c62c-7b0f-4989-8993-a1a6e04ca387 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:44.893916 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-c560c62c-7b0f-4989-8993-a1a6e04ca387 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: 454d121a-d51a-4a5e-9c68-6280d2c6a1b2] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:44.900315 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c560c62c-7b0f-4989-8993-a1a6e04ca387 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:44.900763 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c560c62c-7b0f-4989-8993-a1a6e04ca387 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:44.901503 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c560c62c-7b0f-4989-8993-a1a6e04ca387 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:44.901938 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c560c62c-7b0f-4989-8993-a1a6e04ca387 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:45.036784 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-c560c62c-7b0f-4989-8993-a1a6e04ca387 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:10:45.045015 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-c560c62c-7b0f-4989-8993-a1a6e04ca387 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/454d121a-d51a-4a5e-9c68-6280d2c6a1b2" status: 200 len: 1266 microversion: 2.1 time: 0.156101 Jun 07 22:10:45.045583 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 504/1013] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:10:44 2022] GET /compute/v2.1/servers/454d121a-d51a-4a5e-9c68-6280d2c6a1b2 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:10:46.062046 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-d3d3d98d-d33c-4915-b161-d71a7e82a20a tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:46.062657 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-d3d3d98d-d33c-4915-b161-d71a7e82a20a tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: 454d121a-d51a-4a5e-9c68-6280d2c6a1b2] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:46.069216 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-d3d3d98d-d33c-4915-b161-d71a7e82a20a tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:46.069682 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-d3d3d98d-d33c-4915-b161-d71a7e82a20a tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:46.070416 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-d3d3d98d-d33c-4915-b161-d71a7e82a20a tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:46.070852 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-d3d3d98d-d33c-4915-b161-d71a7e82a20a tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:46.201804 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-d3d3d98d-d33c-4915-b161-d71a7e82a20a tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:10:46.209177 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-d3d3d98d-d33c-4915-b161-d71a7e82a20a tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/454d121a-d51a-4a5e-9c68-6280d2c6a1b2" status: 200 len: 1266 microversion: 2.1 time: 0.151220 Jun 07 22:10:46.209739 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 510/1014] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:10:46 2022] GET /compute/v2.1/servers/454d121a-d51a-4a5e-9c68-6280d2c6a1b2 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:10:47.226565 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-fa97810b-e2fb-439f-b5e6-b467edaa5a7b tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:47.227486 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-fa97810b-e2fb-439f-b5e6-b467edaa5a7b tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: 454d121a-d51a-4a5e-9c68-6280d2c6a1b2] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:47.234541 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-fa97810b-e2fb-439f-b5e6-b467edaa5a7b tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:47.234988 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-fa97810b-e2fb-439f-b5e6-b467edaa5a7b tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:47.235770 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-fa97810b-e2fb-439f-b5e6-b467edaa5a7b tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:47.236206 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-fa97810b-e2fb-439f-b5e6-b467edaa5a7b tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:47.363139 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-fa97810b-e2fb-439f-b5e6-b467edaa5a7b tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:10:47.370681 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-fa97810b-e2fb-439f-b5e6-b467edaa5a7b tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/454d121a-d51a-4a5e-9c68-6280d2c6a1b2" status: 200 len: 1266 microversion: 2.1 time: 0.147939 Jun 07 22:10:47.371246 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 505/1015] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:10:47 2022] GET /compute/v2.1/servers/454d121a-d51a-4a5e-9c68-6280d2c6a1b2 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:10:48.388339 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-1ebcefb2-802f-4a93-a62d-7322d8f48714 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:48.388953 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-1ebcefb2-802f-4a93-a62d-7322d8f48714 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: 454d121a-d51a-4a5e-9c68-6280d2c6a1b2] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:48.391506 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_cell0:SELECT=2 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:10:48.392227 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_cell0:SELECT=6 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:10:48.397922 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-1ebcefb2-802f-4a93-a62d-7322d8f48714 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:48.398368 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-1ebcefb2-802f-4a93-a62d-7322d8f48714 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:48.399126 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-1ebcefb2-802f-4a93-a62d-7322d8f48714 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:48.399595 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-1ebcefb2-802f-4a93-a62d-7322d8f48714 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:48.532170 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-1ebcefb2-802f-4a93-a62d-7322d8f48714 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:10:48.539553 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-1ebcefb2-802f-4a93-a62d-7322d8f48714 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/454d121a-d51a-4a5e-9c68-6280d2c6a1b2" status: 200 len: 1266 microversion: 2.1 time: 0.155529 Jun 07 22:10:48.540107 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 511/1016] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:10:48 2022] GET /compute/v2.1/servers/454d121a-d51a-4a5e-9c68-6280d2c6a1b2 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:10:49.556708 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-9be56780-2bbf-43de-aab3-870c55a5e2d6 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:49.557323 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-9be56780-2bbf-43de-aab3-870c55a5e2d6 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: 454d121a-d51a-4a5e-9c68-6280d2c6a1b2] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:49.559254 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_cell0:SELECT=2 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:10:49.565810 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-9be56780-2bbf-43de-aab3-870c55a5e2d6 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:49.566255 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-9be56780-2bbf-43de-aab3-870c55a5e2d6 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:49.567015 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-9be56780-2bbf-43de-aab3-870c55a5e2d6 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:49.567483 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-9be56780-2bbf-43de-aab3-870c55a5e2d6 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:49.696476 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-9be56780-2bbf-43de-aab3-870c55a5e2d6 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:10:49.704341 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-9be56780-2bbf-43de-aab3-870c55a5e2d6 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/454d121a-d51a-4a5e-9c68-6280d2c6a1b2" status: 200 len: 1266 microversion: 2.1 time: 0.151512 Jun 07 22:10:49.704909 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 506/1017] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:10:49 2022] GET /compute/v2.1/servers/454d121a-d51a-4a5e-9c68-6280d2c6a1b2 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:10:50.721794 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-243a9080-44d5-416d-acef-3fe5701d03c2 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:50.722435 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-243a9080-44d5-416d-acef-3fe5701d03c2 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: 454d121a-d51a-4a5e-9c68-6280d2c6a1b2] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:50.729181 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-243a9080-44d5-416d-acef-3fe5701d03c2 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:50.729630 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-243a9080-44d5-416d-acef-3fe5701d03c2 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:50.730384 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-243a9080-44d5-416d-acef-3fe5701d03c2 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:50.730822 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-243a9080-44d5-416d-acef-3fe5701d03c2 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:50.865655 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-243a9080-44d5-416d-acef-3fe5701d03c2 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:10:50.873893 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-243a9080-44d5-416d-acef-3fe5701d03c2 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/454d121a-d51a-4a5e-9c68-6280d2c6a1b2" status: 200 len: 1266 microversion: 2.1 time: 0.156016 Jun 07 22:10:50.874492 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 512/1018] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:10:50 2022] GET /compute/v2.1/servers/454d121a-d51a-4a5e-9c68-6280d2c6a1b2 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:10:51.890829 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-b8295860-a60e-4413-997e-bfb061b2ac83 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:51.891598 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-b8295860-a60e-4413-997e-bfb061b2ac83 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: 454d121a-d51a-4a5e-9c68-6280d2c6a1b2] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:51.898672 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-b8295860-a60e-4413-997e-bfb061b2ac83 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:51.899126 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-b8295860-a60e-4413-997e-bfb061b2ac83 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:51.899929 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-b8295860-a60e-4413-997e-bfb061b2ac83 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:51.900563 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-b8295860-a60e-4413-997e-bfb061b2ac83 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:52.040596 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-b8295860-a60e-4413-997e-bfb061b2ac83 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:10:52.048632 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-b8295860-a60e-4413-997e-bfb061b2ac83 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/454d121a-d51a-4a5e-9c68-6280d2c6a1b2" status: 200 len: 1266 microversion: 2.1 time: 0.162352 Jun 07 22:10:52.049196 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 507/1019] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:10:51 2022] GET /compute/v2.1/servers/454d121a-d51a-4a5e-9c68-6280d2c6a1b2 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:10:53.120463 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-c54da224-6a7c-4feb-9269-240bb256547e tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:53.121077 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-c54da224-6a7c-4feb-9269-240bb256547e tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: 454d121a-d51a-4a5e-9c68-6280d2c6a1b2] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:53.127433 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c54da224-6a7c-4feb-9269-240bb256547e tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:53.127886 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c54da224-6a7c-4feb-9269-240bb256547e tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:53.128711 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c54da224-6a7c-4feb-9269-240bb256547e tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:53.129147 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c54da224-6a7c-4feb-9269-240bb256547e tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:53.260935 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-c54da224-6a7c-4feb-9269-240bb256547e tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:10:53.268460 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-c54da224-6a7c-4feb-9269-240bb256547e tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/454d121a-d51a-4a5e-9c68-6280d2c6a1b2" status: 200 len: 1266 microversion: 2.1 time: 0.205862 Jun 07 22:10:53.269042 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 513/1020] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:10:53 2022] GET /compute/v2.1/servers/454d121a-d51a-4a5e-9c68-6280d2c6a1b2 => generated 1266 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:10:53.343259 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [req-a5438948-169c-4e44-8d0a-098eba436339 req-31ac3b09-0b97-4210-8c0f-2343fa1421c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "454d121a-d51a-4a5e-9c68-6280d2c6a1b2", "name": "network-vif-plugged", "status": "completed", "tag": "578443e3-4c7f-498f-897f-5639fda8f902"}]} {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:10:53.346785 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=1 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:10:53.354495 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [req-a5438948-169c-4e44-8d0a-098eba436339 req-31ac3b09-0b97-4210-8c0f-2343fa1421c4 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:53.354988 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [req-a5438948-169c-4e44-8d0a-098eba436339 req-31ac3b09-0b97-4210-8c0f-2343fa1421c4 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:53.367190 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.compute.server_external_events [req-a5438948-169c-4e44-8d0a-098eba436339 req-31ac3b09-0b97-4210-8c0f-2343fa1421c4 service nova] Creating event network-vif-plugged:578443e3-4c7f-498f-897f-5639fda8f902 for instance 454d121a-d51a-4a5e-9c68-6280d2c6a1b2 on hv-cinder-83552 Jun 07 22:10:53.372789 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [req-a5438948-169c-4e44-8d0a-098eba436339 req-31ac3b09-0b97-4210-8c0f-2343fa1421c4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034446 Jun 07 22:10:53.373450 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 508/1021] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:10:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:10:54.285473 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-5cff8686-d441-4389-9112-5ddfcf7dffa7 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:54.286080 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-5cff8686-d441-4389-9112-5ddfcf7dffa7 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: 454d121a-d51a-4a5e-9c68-6280d2c6a1b2] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:54.292572 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-5cff8686-d441-4389-9112-5ddfcf7dffa7 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:54.293011 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-5cff8686-d441-4389-9112-5ddfcf7dffa7 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:54.293756 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-5cff8686-d441-4389-9112-5ddfcf7dffa7 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:54.294212 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-5cff8686-d441-4389-9112-5ddfcf7dffa7 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:54.423957 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-5cff8686-d441-4389-9112-5ddfcf7dffa7 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:10:54.431319 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-5cff8686-d441-4389-9112-5ddfcf7dffa7 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/454d121a-d51a-4a5e-9c68-6280d2c6a1b2" status: 200 len: 1266 microversion: 2.1 time: 0.149658 Jun 07 22:10:54.431892 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 514/1022] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:10:54 2022] GET /compute/v2.1/servers/454d121a-d51a-4a5e-9c68-6280d2c6a1b2 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:10:55.450376 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-41a52b5f-6769-4927-8e38-c700127909bb tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:55.451072 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-41a52b5f-6769-4927-8e38-c700127909bb tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: 454d121a-d51a-4a5e-9c68-6280d2c6a1b2] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:55.457349 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-41a52b5f-6769-4927-8e38-c700127909bb tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:55.457799 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-41a52b5f-6769-4927-8e38-c700127909bb tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:55.458556 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-41a52b5f-6769-4927-8e38-c700127909bb tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:55.458997 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-41a52b5f-6769-4927-8e38-c700127909bb tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:55.592923 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-41a52b5f-6769-4927-8e38-c700127909bb tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:10:55.600868 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-41a52b5f-6769-4927-8e38-c700127909bb tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/454d121a-d51a-4a5e-9c68-6280d2c6a1b2" status: 200 len: 1266 microversion: 2.1 time: 0.155164 Jun 07 22:10:55.601434 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 509/1023] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:10:55 2022] GET /compute/v2.1/servers/454d121a-d51a-4a5e-9c68-6280d2c6a1b2 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:10:56.617750 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-356f1f02-076f-4df1-af63-fe1b369de58e tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:56.618378 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-356f1f02-076f-4df1-af63-fe1b369de58e tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: 454d121a-d51a-4a5e-9c68-6280d2c6a1b2] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:56.620667 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:10:56.626637 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-356f1f02-076f-4df1-af63-fe1b369de58e tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:56.627075 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-356f1f02-076f-4df1-af63-fe1b369de58e tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:56.627848 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-356f1f02-076f-4df1-af63-fe1b369de58e tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:56.628276 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-356f1f02-076f-4df1-af63-fe1b369de58e tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:56.763780 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-356f1f02-076f-4df1-af63-fe1b369de58e tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:10:56.771420 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-356f1f02-076f-4df1-af63-fe1b369de58e tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/454d121a-d51a-4a5e-9c68-6280d2c6a1b2" status: 200 len: 1453 microversion: 2.1 time: 0.157505 Jun 07 22:10:56.772024 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 515/1024] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:10:56 2022] GET /compute/v2.1/servers/454d121a-d51a-4a5e-9c68-6280d2c6a1b2 => generated 1453 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:10:56.788004 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-0f60785c-8dfe-4f9d-a76a-a4911471f778 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:10:56.788647 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-0f60785c-8dfe-4f9d-a76a-a4911471f778 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: 454d121a-d51a-4a5e-9c68-6280d2c6a1b2] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:10:56.795053 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0f60785c-8dfe-4f9d-a76a-a4911471f778 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:56.795546 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0f60785c-8dfe-4f9d-a76a-a4911471f778 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:56.796303 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0f60785c-8dfe-4f9d-a76a-a4911471f778 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:56.796737 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0f60785c-8dfe-4f9d-a76a-a4911471f778 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:56.924801 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-0f60785c-8dfe-4f9d-a76a-a4911471f778 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:10:56.932320 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-0f60785c-8dfe-4f9d-a76a-a4911471f778 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/454d121a-d51a-4a5e-9c68-6280d2c6a1b2" status: 200 len: 1453 microversion: 2.1 time: 0.148176 Jun 07 22:10:56.932888 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 510/1025] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:10:56 2022] GET /compute/v2.1/servers/454d121a-d51a-4a5e-9c68-6280d2c6a1b2 => generated 1453 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:10:58.790412 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [req-6fd1e0a0-30a2-482d-a6c0-23ca5b31dff5 req-c727db63-a111-4f52-abc7-018e1a924288 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "454d121a-d51a-4a5e-9c68-6280d2c6a1b2", "tag": "578443e3-4c7f-498f-897f-5639fda8f902"}]} {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:10:58.799037 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-6fd1e0a0-30a2-482d-a6c0-23ca5b31dff5 req-c727db63-a111-4f52-abc7-018e1a924288 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:10:58.799504 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-6fd1e0a0-30a2-482d-a6c0-23ca5b31dff5 req-c727db63-a111-4f52-abc7-018e1a924288 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:10:58.810498 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.compute.server_external_events [req-6fd1e0a0-30a2-482d-a6c0-23ca5b31dff5 req-c727db63-a111-4f52-abc7-018e1a924288 service nova] Creating event network-changed:578443e3-4c7f-498f-897f-5639fda8f902 for instance 454d121a-d51a-4a5e-9c68-6280d2c6a1b2 on hv-cinder-83552 Jun 07 22:10:58.815566 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [req-6fd1e0a0-30a2-482d-a6c0-23ca5b31dff5 req-c727db63-a111-4f52-abc7-018e1a924288 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028732 Jun 07 22:10:58.816154 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 516/1026] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:10:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:11:07.839048 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_api:SELECT=5 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:11:07.839796 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_cell1:SELECT=45 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:11:07.939435 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-405160ba-080b-47bf-ab77-59f05d77fb1b tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:11:07.939950 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-405160ba-080b-47bf-ab77-59f05d77fb1b tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:11:07.945839 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-405160ba-080b-47bf-ab77-59f05d77fb1b tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:07.946282 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-405160ba-080b-47bf-ab77-59f05d77fb1b tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:07.947032 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-405160ba-080b-47bf-ab77-59f05d77fb1b tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:07.947497 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-405160ba-080b-47bf-ab77-59f05d77fb1b tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:07.976536 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-405160ba-080b-47bf-ab77-59f05d77fb1b tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95/os-volume_attachments/8dcad951-3f5e-450d-bc7a-2e66067591bc" status: 200 len: 194 microversion: 2.20 time: 0.142698 Jun 07 22:11:07.977354 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 511/1027] 10.222.0.13 () {60 vars in 1453 bytes} [Tue Jun 7 22:11:07 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95/os-volume_attachments/8dcad951-3f5e-450d-bc7a-2e66067591bc => generated 194 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 22:11:08.038946 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-8833fb98-d8f3-49b3-9a25-27bdbb68b674 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:11:08.039784 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-8833fb98-d8f3-49b3-9a25-27bdbb68b674 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:11:08.046234 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-8833fb98-d8f3-49b3-9a25-27bdbb68b674 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:08.046683 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-8833fb98-d8f3-49b3-9a25-27bdbb68b674 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:08.047660 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-8833fb98-d8f3-49b3-9a25-27bdbb68b674 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:08.048089 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-8833fb98-d8f3-49b3-9a25-27bdbb68b674 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:08.050805 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_cell1:SELECT=82 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:11:08.132237 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.objects.instance [None req-8833fb98-d8f3-49b3-9a25-27bdbb68b674 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lazy-loading 'services' on Instance uuid 07abb105-095a-47ad-8761-b5075254ac95 {{(pid=117971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 22:11:08.202023 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-8833fb98-d8f3-49b3-9a25-27bdbb68b674 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "DELETE /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95/os-volume_attachments/8dcad951-3f5e-450d-bc7a-2e66067591bc" status: 202 len: 0 microversion: 2.20 time: 0.167922 Jun 07 22:11:08.202602 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 517/1028] 10.222.0.13 () {60 vars in 1456 bytes} [Tue Jun 7 22:11:08 2022] DELETE /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95/os-volume_attachments/8dcad951-3f5e-450d-bc7a-2e66067591bc => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 07 22:11:08.211709 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-b768df35-cf7b-44ea-9786-58990ef418cf tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:11:08.212683 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-b768df35-cf7b-44ea-9786-58990ef418cf tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:11:08.218930 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-b768df35-cf7b-44ea-9786-58990ef418cf tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:08.219584 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-b768df35-cf7b-44ea-9786-58990ef418cf tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:08.220369 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-b768df35-cf7b-44ea-9786-58990ef418cf tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:08.221005 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-b768df35-cf7b-44ea-9786-58990ef418cf tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:08.251241 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-b768df35-cf7b-44ea-9786-58990ef418cf tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043542 Jun 07 22:11:08.251840 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 512/1029] 10.222.0.13 () {60 vars in 1342 bytes} [Tue Jun 7 22:11:08 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 22:11:09.264093 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-6af305d1-1aca-45f5-912d-2b14ba163f21 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:11:09.265213 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-6af305d1-1aca-45f5-912d-2b14ba163f21 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:11:09.272340 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-6af305d1-1aca-45f5-912d-2b14ba163f21 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:09.272783 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-6af305d1-1aca-45f5-912d-2b14ba163f21 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:09.273537 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-6af305d1-1aca-45f5-912d-2b14ba163f21 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:09.273966 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-6af305d1-1aca-45f5-912d-2b14ba163f21 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:09.303986 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-6af305d1-1aca-45f5-912d-2b14ba163f21 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044775 Jun 07 22:11:09.304759 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 518/1030] 10.222.0.13 () {60 vars in 1342 bytes} [Tue Jun 7 22:11:09 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 22:11:09.666334 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-4dbe49cb-1ec9-49fa-9036-29af35d007d6 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-878203466"}} {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:11:09.666866 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-4dbe49cb-1ec9-49fa-9036-29af35d007d6 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:11:09.672839 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4dbe49cb-1ec9-49fa-9036-29af35d007d6 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:09.673284 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4dbe49cb-1ec9-49fa-9036-29af35d007d6 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:09.674039 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4dbe49cb-1ec9-49fa-9036-29af35d007d6 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:09.674470 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4dbe49cb-1ec9-49fa-9036-29af35d007d6 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:09.801447 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.network.security_group_api [None req-4dbe49cb-1ec9-49fa-9036-29af35d007d6 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Removing security group 4c3bb260-6094-458d-98a1-872c756dd1cd from port 93fff328-2cf7-4f1c-9e4e-23777eeb1a75 Jun 07 22:11:10.186365 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-4dbe49cb-1ec9-49fa-9036-29af35d007d6 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "POST /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b/action" status: 202 len: 0 microversion: 2.1 time: 0.620679 Jun 07 22:11:10.190702 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 513/1031] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Jun 7 22:11:09 2022] POST /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b/action => generated 0 bytes in 622 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 22:11:10.201782 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [req-035ac2a9-4d94-4b34-9d00-c7245fa4b292 req-73b5cc0b-692f-4970-a7ad-e80594c597d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbab64b0-0fb5-49d7-aeeb-d744856ddc2b", "tag": "93fff328-2cf7-4f1c-9e4e-23777eeb1a75"}]} {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:11:10.224004 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-035ac2a9-4d94-4b34-9d00-c7245fa4b292 req-73b5cc0b-692f-4970-a7ad-e80594c597d3 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:10.224877 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-035ac2a9-4d94-4b34-9d00-c7245fa4b292 req-73b5cc0b-692f-4970-a7ad-e80594c597d3 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:10.263866 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.compute.server_external_events [req-035ac2a9-4d94-4b34-9d00-c7245fa4b292 req-73b5cc0b-692f-4970-a7ad-e80594c597d3 service nova] Creating event network-changed:93fff328-2cf7-4f1c-9e4e-23777eeb1a75 for instance fbab64b0-0fb5-49d7-aeeb-d744856ddc2b on hv-cinder-83552 Jun 07 22:11:10.271506 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [req-035ac2a9-4d94-4b34-9d00-c7245fa4b292 req-73b5cc0b-692f-4970-a7ad-e80594c597d3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077155 Jun 07 22:11:10.273547 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 519/1032] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:11:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:11:10.318951 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-4256e2c8-5875-4cf8-a7eb-6070fcb05484 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:11:10.319922 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-4256e2c8-5875-4cf8-a7eb-6070fcb05484 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:11:10.328521 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4256e2c8-5875-4cf8-a7eb-6070fcb05484 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:10.329645 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4256e2c8-5875-4cf8-a7eb-6070fcb05484 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:10.330706 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4256e2c8-5875-4cf8-a7eb-6070fcb05484 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:10.331481 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4256e2c8-5875-4cf8-a7eb-6070fcb05484 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:10.369891 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-4256e2c8-5875-4cf8-a7eb-6070fcb05484 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.057662 Jun 07 22:11:10.370531 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 514/1033] 10.222.0.13 () {60 vars in 1342 bytes} [Tue Jun 7 22:11:10 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:11:10.447973 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-c0e70690-d8b6-422f-b0b2-65b4576c9617 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:11:10.448836 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-c0e70690-d8b6-422f-b0b2-65b4576c9617 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:11:10.462245 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c0e70690-d8b6-422f-b0b2-65b4576c9617 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:10.462738 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c0e70690-d8b6-422f-b0b2-65b4576c9617 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:10.463908 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c0e70690-d8b6-422f-b0b2-65b4576c9617 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:10.464479 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c0e70690-d8b6-422f-b0b2-65b4576c9617 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:10.504775 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-c0e70690-d8b6-422f-b0b2-65b4576c9617 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Going to try to terminate instance {{(pid=117971) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 22:11:10.629497 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-c0e70690-d8b6-422f-b0b2-65b4576c9617 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "DELETE /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 204 len: 0 microversion: 2.20 time: 0.186740 Jun 07 22:11:10.631766 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 520/1034] 10.222.0.13 () {60 vars in 1279 bytes} [Tue Jun 7 22:11:10 2022] DELETE /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 07 22:11:10.640901 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-0566a8fc-8c10-431f-973a-83271a59d286 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:11:10.641886 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-0566a8fc-8c10-431f-973a-83271a59d286 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:11:10.651387 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0566a8fc-8c10-431f-973a-83271a59d286 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:10.651834 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0566a8fc-8c10-431f-973a-83271a59d286 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:10.652647 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0566a8fc-8c10-431f-973a-83271a59d286 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:10.653144 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0566a8fc-8c10-431f-973a-83271a59d286 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:10.788663 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-0566a8fc-8c10-431f-973a-83271a59d286 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:11:10.797491 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-0566a8fc-8c10-431f-973a-83271a59d286 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:11:10.799072 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-0566a8fc-8c10-431f-973a-83271a59d286 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:11:10.800257 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-0566a8fc-8c10-431f-973a-83271a59d286 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1724 microversion: 2.20 time: 0.165233 Jun 07 22:11:10.800814 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 515/1035] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:11:10 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 22:11:11.452036 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-02fd1587-e162-46d6-b780-2cba34229e82 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:11:11.452618 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-02fd1587-e162-46d6-b780-2cba34229e82 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:11:11.459804 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-02fd1587-e162-46d6-b780-2cba34229e82 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:11.460353 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-02fd1587-e162-46d6-b780-2cba34229e82 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:11.461220 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-02fd1587-e162-46d6-b780-2cba34229e82 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:11.461747 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-02fd1587-e162-46d6-b780-2cba34229e82 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:11.514503 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [req-e4fbfa48-d9b3-4fb6-8c13-766d17c8ff2b req-6a4b5620-a8dc-4d28-9b15-bc8030ad7d65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbab64b0-0fb5-49d7-aeeb-d744856ddc2b", "tag": "93fff328-2cf7-4f1c-9e4e-23777eeb1a75"}]} {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:11:11.523686 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [req-e4fbfa48-d9b3-4fb6-8c13-766d17c8ff2b req-6a4b5620-a8dc-4d28-9b15-bc8030ad7d65 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:11.524131 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [req-e4fbfa48-d9b3-4fb6-8c13-766d17c8ff2b req-6a4b5620-a8dc-4d28-9b15-bc8030ad7d65 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:11.536202 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.compute.server_external_events [req-e4fbfa48-d9b3-4fb6-8c13-766d17c8ff2b req-6a4b5620-a8dc-4d28-9b15-bc8030ad7d65 service nova] Creating event network-changed:93fff328-2cf7-4f1c-9e4e-23777eeb1a75 for instance fbab64b0-0fb5-49d7-aeeb-d744856ddc2b on hv-cinder-83552 Jun 07 22:11:11.541625 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [req-e4fbfa48-d9b3-4fb6-8c13-766d17c8ff2b req-6a4b5620-a8dc-4d28-9b15-bc8030ad7d65 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090889 Jun 07 22:11:11.542356 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 516/1036] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:11:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 22:11:11.550865 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.objects.instance [None req-02fd1587-e162-46d6-b780-2cba34229e82 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lazy-loading 'services' on Instance uuid fbab64b0-0fb5-49d7-aeeb-d744856ddc2b {{(pid=117971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 22:11:11.624153 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-02fd1587-e162-46d6-b780-2cba34229e82 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "DELETE /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b/os-volume_attachments/2ce86c91-0329-442f-a259-f9fb38918f80" status: 202 len: 0 microversion: 2.1 time: 0.176612 Jun 07 22:11:11.625352 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 521/1037] 10.222.0.13 () {58 vars in 1415 bytes} [Tue Jun 7 22:11:11 2022] DELETE /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b/os-volume_attachments/2ce86c91-0329-442f-a259-f9fb38918f80 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 22:11:11.634407 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-2abbf588-8d43-4c6c-8bc2-695a30d4bb8f tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:11:11.635459 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-2abbf588-8d43-4c6c-8bc2-695a30d4bb8f tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:11:11.642412 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-2abbf588-8d43-4c6c-8bc2-695a30d4bb8f tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:11.642869 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-2abbf588-8d43-4c6c-8bc2-695a30d4bb8f tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:11.643672 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-2abbf588-8d43-4c6c-8bc2-695a30d4bb8f tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:11.644109 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-2abbf588-8d43-4c6c-8bc2-695a30d4bb8f tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:11.676648 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-2abbf588-8d43-4c6c-8bc2-695a30d4bb8f tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046465 Jun 07 22:11:11.680755 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 517/1038] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jun 7 22:11:11 2022] GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:11:11.818997 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-b9133810-6869-4946-ae53-c6cfe4e4939f tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:11:11.819738 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-b9133810-6869-4946-ae53-c6cfe4e4939f tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:11:11.825988 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b9133810-6869-4946-ae53-c6cfe4e4939f tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:11.826371 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b9133810-6869-4946-ae53-c6cfe4e4939f tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:11.827136 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b9133810-6869-4946-ae53-c6cfe4e4939f tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:11.827595 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b9133810-6869-4946-ae53-c6cfe4e4939f tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:11.961165 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-b9133810-6869-4946-ae53-c6cfe4e4939f tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:11:11.969813 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-b9133810-6869-4946-ae53-c6cfe4e4939f tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:11:11.971491 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-b9133810-6869-4946-ae53-c6cfe4e4939f tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:11:11.972754 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-b9133810-6869-4946-ae53-c6cfe4e4939f tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1724 microversion: 2.20 time: 0.157967 Jun 07 22:11:11.973321 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 522/1039] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:11:11 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:11:12.689244 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-b9d601e2-3e47-405c-ad18-72fd1a49d66d tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:11:12.690759 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-b9d601e2-3e47-405c-ad18-72fd1a49d66d tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:11:12.697680 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-b9d601e2-3e47-405c-ad18-72fd1a49d66d tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:12.698381 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-b9d601e2-3e47-405c-ad18-72fd1a49d66d tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:12.699492 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-b9d601e2-3e47-405c-ad18-72fd1a49d66d tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:12.700091 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-b9d601e2-3e47-405c-ad18-72fd1a49d66d tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:12.735083 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-b9d601e2-3e47-405c-ad18-72fd1a49d66d tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050444 Jun 07 22:11:12.735703 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 518/1040] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jun 7 22:11:12 2022] GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:11:12.991423 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-760387c0-917e-47b4-9021-5c5f2170cf07 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:11:12.991948 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-760387c0-917e-47b4-9021-5c5f2170cf07 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:11:12.998728 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-760387c0-917e-47b4-9021-5c5f2170cf07 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:12.999172 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-760387c0-917e-47b4-9021-5c5f2170cf07 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:13.000589 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-760387c0-917e-47b4-9021-5c5f2170cf07 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:13.001019 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-760387c0-917e-47b4-9021-5c5f2170cf07 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:13.147114 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-760387c0-917e-47b4-9021-5c5f2170cf07 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:11:13.155273 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-760387c0-917e-47b4-9021-5c5f2170cf07 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:11:13.157010 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-760387c0-917e-47b4-9021-5c5f2170cf07 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:11:13.158161 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-760387c0-917e-47b4-9021-5c5f2170cf07 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1724 microversion: 2.20 time: 0.170762 Jun 07 22:11:13.158722 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 523/1041] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:11:12 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:11:13.746422 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-870b9681-3552-462d-82ac-898ca46b3552 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:11:13.747350 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-870b9681-3552-462d-82ac-898ca46b3552 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:11:13.754242 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-870b9681-3552-462d-82ac-898ca46b3552 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:13.754688 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-870b9681-3552-462d-82ac-898ca46b3552 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:13.755466 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-870b9681-3552-462d-82ac-898ca46b3552 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:13.755906 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-870b9681-3552-462d-82ac-898ca46b3552 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:13.803749 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-870b9681-3552-462d-82ac-898ca46b3552 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061157 Jun 07 22:11:13.804664 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 519/1042] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jun 7 22:11:13 2022] GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:11:14.177400 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-d21ffc40-252f-46bc-b58a-2f8219501741 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:11:14.178049 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-d21ffc40-252f-46bc-b58a-2f8219501741 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:11:14.184994 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-d21ffc40-252f-46bc-b58a-2f8219501741 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:14.185442 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-d21ffc40-252f-46bc-b58a-2f8219501741 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:14.186208 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-d21ffc40-252f-46bc-b58a-2f8219501741 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:14.186644 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-d21ffc40-252f-46bc-b58a-2f8219501741 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:14.326550 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-d21ffc40-252f-46bc-b58a-2f8219501741 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:11:14.335755 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-d21ffc40-252f-46bc-b58a-2f8219501741 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:11:14.337266 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-d21ffc40-252f-46bc-b58a-2f8219501741 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:11:14.341553 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-d21ffc40-252f-46bc-b58a-2f8219501741 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1724 microversion: 2.20 time: 0.168419 Jun 07 22:11:14.356238 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 524/1043] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:11:14 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:11:14.770971 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [req-0aa77bfa-a11f-4b0f-a5ec-b436bfb947d7 req-b5707943-6469-4500-a643-d98258fec150 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07abb105-095a-47ad-8761-b5075254ac95", "name": "network-vif-deleted", "tag": "dfed4201-3c81-4b15-b164-8dd355eaca62"}]} {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:11:14.779967 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [req-0aa77bfa-a11f-4b0f-a5ec-b436bfb947d7 req-b5707943-6469-4500-a643-d98258fec150 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:14.780410 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [req-0aa77bfa-a11f-4b0f-a5ec-b436bfb947d7 req-b5707943-6469-4500-a643-d98258fec150 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:14.802465 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.compute.server_external_events [req-0aa77bfa-a11f-4b0f-a5ec-b436bfb947d7 req-b5707943-6469-4500-a643-d98258fec150 service nova] Creating event network-vif-deleted:dfed4201-3c81-4b15-b164-8dd355eaca62 for instance 07abb105-095a-47ad-8761-b5075254ac95 on hv-cinder-83552 Jun 07 22:11:14.816438 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-46832ad3-ff17-41c4-9bd5-2529652ece2a tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:11:14.817724 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-46832ad3-ff17-41c4-9bd5-2529652ece2a tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:11:14.825668 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-46832ad3-ff17-41c4-9bd5-2529652ece2a tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:14.826312 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-46832ad3-ff17-41c4-9bd5-2529652ece2a tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:14.827260 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-46832ad3-ff17-41c4-9bd5-2529652ece2a tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:14.828501 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-46832ad3-ff17-41c4-9bd5-2529652ece2a tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:14.831179 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [req-0aa77bfa-a11f-4b0f-a5ec-b436bfb947d7 req-b5707943-6469-4500-a643-d98258fec150 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062331 Jun 07 22:11:14.837058 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 520/1044] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:11:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:11:14.862250 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-46832ad3-ff17-41c4-9bd5-2529652ece2a tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050486 Jun 07 22:11:14.862920 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 525/1045] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jun 7 22:11:14 2022] GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 07 22:11:14.875318 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-97e04b0c-782a-4a26-be46-5a5e39e3f72e tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:11:14.877412 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-97e04b0c-782a-4a26-be46-5a5e39e3f72e tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:11:14.884735 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-97e04b0c-782a-4a26-be46-5a5e39e3f72e tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:14.885269 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-97e04b0c-782a-4a26-be46-5a5e39e3f72e tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:14.886160 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-97e04b0c-782a-4a26-be46-5a5e39e3f72e tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:14.886665 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-97e04b0c-782a-4a26-be46-5a5e39e3f72e tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:14.968808 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.wsgi [None req-97e04b0c-782a-4a26-be46-5a5e39e3f72e tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] HTTP exception thrown: Instance fbab64b0-0fb5-49d7-aeeb-d744856ddc2b is not attached to volume 2ce86c91-0329-442f-a259-f9fb38918f80 Jun 07 22:11:14.979009 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-97e04b0c-782a-4a26-be46-5a5e39e3f72e tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Request method failure captured: Jun 07 22:11:14.979009 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: request: DELETE /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b/os-volume_attachments/2ce86c91-0329-442f-a259-f9fb38918f80 HTTP/1.1 Jun 07 22:11:14.979009 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Accept: application/json Jun 07 22:11:14.979009 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Accept-Encoding: identity Jun 07 22:11:14.979009 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Connection: close Jun 07 22:11:14.979009 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Content-Length: 0 Jun 07 22:11:14.979009 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Content-Type: application/json Jun 07 22:11:14.979009 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Host: 10.222.0.13 Jun 07 22:11:14.979009 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Openstack-System-Scope: None Jun 07 22:11:14.979009 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: User-Agent: python-urllib3/1.26.9 Jun 07 22:11:14.979009 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Auth-Token: gAAAAABin8um5LWa0hDjlmciLFyaGnTtXNUfDugvo1YakM6gnHap0TXndc3Hr9pSWFvSCmvOXssVIFZCbWgRGsQLmK9YkT4522Fw4f5rEQz4XrHLXvdDYG0VgRJECdZSL9tIO4jgkjndFtzrOlGwB69C3TbmQdaOvfKFEtRX9MdSlBHO3LUUL_8 Jun 07 22:11:14.979009 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Domain-Id: None Jun 07 22:11:14.979009 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Domain-Name: None Jun 07 22:11:14.979009 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Identity-Status: Confirmed Jun 07 22:11:14.979009 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Is-Admin-Project: True Jun 07 22:11:14.979009 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Domain-Id: default Jun 07 22:11:14.979009 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Domain-Name: Default Jun 07 22:11:14.979009 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Id: bd31cd38d46643fbac516d21ee4f89ac Jun 07 22:11:14.979009 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Name: tempest-TestMinimumBasicScenario-1549554481 Jun 07 22:11:14.979009 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Role: member,reader Jun 07 22:11:14.979009 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Roles: member,reader Jun 07 22:11:14.980656 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/bd31cd38d46643fbac516d21ee4f89ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_bd31cd38d46643fbac516d21ee4f89ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/bd31cd38d46643fbac516d21ee4f89ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/bd31cd38d46643fbac516d21ee4f89ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}] Jun 07 22:11:14.980656 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Tenant: tempest-TestMinimumBasicScenario-1549554481 Jun 07 22:11:14.980656 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Tenant-Id: bd31cd38d46643fbac516d21ee4f89ac Jun 07 22:11:14.980656 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1549554481 Jun 07 22:11:14.980656 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User: tempest-TestMinimumBasicScenario-1549554481-project Jun 07 22:11:14.980656 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Domain-Id: default Jun 07 22:11:14.980656 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Domain-Name: Default Jun 07 22:11:14.980656 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Id: 7af02cd6ffd0484c8f6569629cd6313c Jun 07 22:11:14.980656 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Name: tempest-TestMinimumBasicScenario-1549554481-project Jun 07 22:11:14.980656 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: method: > Jun 07 22:11:14.980656 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: exception: Instance fbab64b0-0fb5-49d7-aeeb-d744856ddc2b is not attached to volume 2ce86c91-0329-442f-a259-f9fb38918f80 Jun 07 22:11:14.981510 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: action_args: {'server_id': 'fbab64b0-0fb5-49d7-aeeb-d744856ddc2b', 'id': '2ce86c91-0329-442f-a259-f9fb38918f80'} Jun 07 22:11:14.981510 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 22:11:14.981510 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:11:14.981510 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 07 22:11:14.981510 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 07 22:11:14.981510 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 07 22:11:14.981510 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 07 22:11:14.981510 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 07 22:11:14.981510 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 07 22:11:14.981510 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 2ce86c91-0329-442f-a259-f9fb38918f80. Jun 07 22:11:14.981510 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:11:14.981510 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:11:14.981510 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:11:14.981510 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:11:14.981510 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:11:14.981510 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:11:14.981510 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 22:11:14.981510 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 22:11:14.981510 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 22:11:14.982841 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 22:11:14.982841 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 07 22:11:14.982841 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 07 22:11:14.982841 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbab64b0-0fb5-49d7-aeeb-d744856ddc2b is not attached to volume 2ce86c91-0329-442f-a259-f9fb38918f80 Jun 07 22:11:14.982841 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:11:14.982841 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:11:14.982841 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:11:14.982841 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:11:14.982841 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:11:14.982841 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:11:14.982841 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 22:11:14.982841 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 22:11:14.982841 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbab64b0-0fb5-49d7-aeeb-d744856ddc2b is not attached to volume 2ce86c91-0329-442f-a259-f9fb38918f80 Jun 07 22:11:14.982841 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:11:14.982841 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-97e04b0c-782a-4a26-be46-5a5e39e3f72e tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Returning 404 to user: Instance fbab64b0-0fb5-49d7-aeeb-d744856ddc2b is not attached to volume 2ce86c91-0329-442f-a259-f9fb38918f80 {{(pid=117970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 22:11:14.985364 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-97e04b0c-782a-4a26-be46-5a5e39e3f72e tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "DELETE /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b/os-volume_attachments/2ce86c91-0329-442f-a259-f9fb38918f80" status: 404 len: 154 microversion: 2.1 time: 0.110464 Jun 07 22:11:14.985364 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 521/1046] 10.222.0.13 () {58 vars in 1415 bytes} [Tue Jun 7 22:11:14 2022] DELETE /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b/os-volume_attachments/2ce86c91-0329-442f-a259-f9fb38918f80 => generated 154 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 07 22:11:15.360577 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-bb0b462f-6ac7-44f4-ab2d-c104ded05142 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:11:15.361195 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-bb0b462f-6ac7-44f4-ab2d-c104ded05142 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:11:15.367905 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-bb0b462f-6ac7-44f4-ab2d-c104ded05142 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:15.375038 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-bb0b462f-6ac7-44f4-ab2d-c104ded05142 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:15.375937 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-bb0b462f-6ac7-44f4-ab2d-c104ded05142 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:15.376391 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-bb0b462f-6ac7-44f4-ab2d-c104ded05142 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:15.421683 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-bb0b462f-6ac7-44f4-ab2d-c104ded05142 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:15.422249 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-bb0b462f-6ac7-44f4-ab2d-c104ded05142 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:15.423217 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.objects.instance [None req-bb0b462f-6ac7-44f4-ab2d-c104ded05142 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lazy-loading 'fault' on Instance uuid 07abb105-095a-47ad-8761-b5075254ac95 {{(pid=117971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 22:11:15.482235 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-bb0b462f-6ac7-44f4-ab2d-c104ded05142 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:11:15.491543 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-bb0b462f-6ac7-44f4-ab2d-c104ded05142 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:11:15.494088 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-bb0b462f-6ac7-44f4-ab2d-c104ded05142 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:11:15.495696 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-bb0b462f-6ac7-44f4-ab2d-c104ded05142 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 200 len: 1372 microversion: 2.20 time: 0.139371 Jun 07 22:11:15.496909 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 526/1047] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:11:15 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 1372 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:11:16.118862 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-21e17d72-c6c1-4419-a610-23d71c1d0118 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:11:16.119418 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-21e17d72-c6c1-4419-a610-23d71c1d0118 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:11:16.126819 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-21e17d72-c6c1-4419-a610-23d71c1d0118 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:16.127262 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-21e17d72-c6c1-4419-a610-23d71c1d0118 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:16.128038 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-21e17d72-c6c1-4419-a610-23d71c1d0118 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:16.128463 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-21e17d72-c6c1-4419-a610-23d71c1d0118 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:16.153990 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-21e17d72-c6c1-4419-a610-23d71c1d0118 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Going to try to terminate instance {{(pid=117970) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 22:11:16.230176 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-21e17d72-c6c1-4419-a610-23d71c1d0118 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "DELETE /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b" status: 204 len: 0 microversion: 2.1 time: 0.114930 Jun 07 22:11:16.230860 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 522/1048] 10.222.0.13 () {58 vars in 1238 bytes} [Tue Jun 7 22:11:16 2022] DELETE /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 22:11:16.240484 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-30538dff-70ed-4df2-9e11-72cadb727d91 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:11:16.241088 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-30538dff-70ed-4df2-9e11-72cadb727d91 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:11:16.247458 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-30538dff-70ed-4df2-9e11-72cadb727d91 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:16.247902 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-30538dff-70ed-4df2-9e11-72cadb727d91 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:16.248646 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-30538dff-70ed-4df2-9e11-72cadb727d91 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:16.249075 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-30538dff-70ed-4df2-9e11-72cadb727d91 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:16.379854 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-30538dff-70ed-4df2-9e11-72cadb727d91 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af02cd6ffd0484c8f6569629cd6313c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31cd38d46643fbac516d21ee4f89ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:11:16.387246 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-30538dff-70ed-4df2-9e11-72cadb727d91 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b" status: 200 len: 1552 microversion: 2.1 time: 0.150808 Jun 07 22:11:16.387837 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 527/1049] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:11:16 2022] GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b => generated 1552 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:11:16.518268 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-1cb11a1e-a984-4cac-96e7-549771b005ab tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:11:16.518959 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-1cb11a1e-a984-4cac-96e7-549771b005ab tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:11:16.524950 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1cb11a1e-a984-4cac-96e7-549771b005ab tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:16.525395 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1cb11a1e-a984-4cac-96e7-549771b005ab tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:16.526142 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1cb11a1e-a984-4cac-96e7-549771b005ab tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:16.526576 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1cb11a1e-a984-4cac-96e7-549771b005ab tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:16.542005 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.wsgi [None req-1cb11a1e-a984-4cac-96e7-549771b005ab tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] HTTP exception thrown: Instance 07abb105-095a-47ad-8761-b5075254ac95 could not be found. Jun 07 22:11:16.543933 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-1cb11a1e-a984-4cac-96e7-549771b005ab tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Request method failure captured: Jun 07 22:11:16.543933 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: request: GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 HTTP/1.1 Jun 07 22:11:16.543933 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Accept: application/json Jun 07 22:11:16.543933 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Accept-Encoding: identity Jun 07 22:11:16.543933 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Connection: close Jun 07 22:11:16.543933 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Content-Length: 0 Jun 07 22:11:16.543933 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Content-Type: application/json Jun 07 22:11:16.543933 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Host: 10.222.0.13 Jun 07 22:11:16.543933 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Openstack-System-Scope: None Jun 07 22:11:16.543933 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: User-Agent: python-urllib3/1.26.9 Jun 07 22:11:16.543933 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Auth-Token: gAAAAABin8uPjY2n2U1UfD4BAC2BIPUnwdSjtmQlXMcGhyJKVuNwqCxKLwue5dUbR_nnn0f1dXWMonXAfPVmaYaFFK195PB3zvnPxXy5QcfNuc_jj0zriGmy8yorTG8wSIV834eMYCFSAP3BcLoYzwSynfDxfY2lVxuTIQljKk3LHvbzv2JrNjM Jun 07 22:11:16.543933 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Domain-Id: None Jun 07 22:11:16.543933 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Domain-Name: None Jun 07 22:11:16.543933 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Identity-Status: Confirmed Jun 07 22:11:16.543933 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Is-Admin-Project: True Jun 07 22:11:16.543933 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Openstack-Nova-Api-Version: 2.20 Jun 07 22:11:16.543933 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Domain-Id: default Jun 07 22:11:16.543933 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Domain-Name: Default Jun 07 22:11:16.543933 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Id: 9f0ee4be50354a20baf5af85aeb4c3b2 Jun 07 22:11:16.543933 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1012893920 Jun 07 22:11:16.543933 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Role: member,reader Jun 07 22:11:16.543933 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Roles: member,reader Jun 07 22:11:16.545698 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9f0ee4be50354a20baf5af85aeb4c3b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9f0ee4be50354a20baf5af85aeb4c3b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9f0ee4be50354a20baf5af85aeb4c3b2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9f0ee4be50354a20baf5af85aeb4c3b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}] Jun 07 22:11:16.545698 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1012893920 Jun 07 22:11:16.545698 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Tenant-Id: 9f0ee4be50354a20baf5af85aeb4c3b2 Jun 07 22:11:16.545698 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1012893920 Jun 07 22:11:16.545698 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User: tempest-AttachVolumeShelveTestJSON-1012893920-project Jun 07 22:11:16.545698 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Domain-Id: default Jun 07 22:11:16.545698 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Domain-Name: Default Jun 07 22:11:16.545698 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Id: de021dc74a4446d8b6a63883fd56a7c4 Jun 07 22:11:16.545698 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1012893920-project Jun 07 22:11:16.545698 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: method: > Jun 07 22:11:16.545698 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: exception: Instance 07abb105-095a-47ad-8761-b5075254ac95 could not be found. Jun 07 22:11:16.545698 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: action_args: {'id': '07abb105-095a-47ad-8761-b5075254ac95'} Jun 07 22:11:16.547592 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 22:11:16.547592 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:11:16.547592 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 22:11:16.547592 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 22:11:16.547592 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 22:11:16.547592 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 22:11:16.547592 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 22:11:16.547592 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 22:11:16.547592 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 22:11:16.547592 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 22:11:16.547592 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07abb105-095a-47ad-8761-b5075254ac95 could not be found. Jun 07 22:11:16.547592 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:11:16.547592 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:11:16.547592 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:11:16.547592 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:11:16.547592 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:11:16.547592 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:11:16.547592 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 22:11:16.547592 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 22:11:16.547592 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 22:11:16.549074 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 22:11:16.549074 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 22:11:16.549074 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 22:11:16.549074 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 22:11:16.549074 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 22:11:16.549074 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 22:11:16.549074 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 22:11:16.549074 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07abb105-095a-47ad-8761-b5075254ac95 could not be found. Jun 07 22:11:16.549074 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:11:16.549074 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:11:16.549074 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:11:16.549074 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:11:16.549074 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:11:16.549074 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:11:16.549074 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 22:11:16.549074 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 22:11:16.549074 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07abb105-095a-47ad-8761-b5075254ac95 could not be found. Jun 07 22:11:16.549074 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:11:16.550586 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-1cb11a1e-a984-4cac-96e7-549771b005ab tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Returning 404 to user: Instance 07abb105-095a-47ad-8761-b5075254ac95 could not be found. {{(pid=117970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 22:11:16.550586 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-1cb11a1e-a984-4cac-96e7-549771b005ab tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 404 len: 111 microversion: 2.20 time: 0.031335 Jun 07 22:11:16.550586 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 523/1050] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:11:16 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 07 22:11:16.554918 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-d0f3b15f-5328-4f45-a553-eceef6290ff0 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '.version_select at 0x7f92f13fb5e0>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:11:16.572038 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-d0f3b15f-5328-4f45-a553-eceef6290ff0 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1041837428" status: 204 len: 0 microversion: 2.20 time: 0.020912 Jun 07 22:11:16.572566 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 528/1051] 10.222.0.13 () {60 vars in 1261 bytes} [Tue Jun 7 22:11:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1041837428 => generated 0 bytes in 22 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 07 22:11:17.191184 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-daf085d8-a8ff-4755-915a-6587f47dd463 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Action: 'create', calling method: .version_select at 0x7f92f65b2e50>, body: {"keypair": {"name": "tempest-keypair-698275809", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAj/hnoxX7CQLpxiKKnrBe+LIUV3lY3KeWxsffQLv66vN3saFnVHwj+Tty+QlHEg/TPPo28XkzCCvoO6/2PfrjSjQoQQotrl+z3qZd9DKe+AJiNNWLPfBrnc4M+7DPmDWA=="}} {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:11:17.205968 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.quota [None req-daf085d8-a8ff-4755-915a-6587f47dd463 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Getting quotas for project 9f0ee4be50354a20baf5af85aeb4c3b2. Resources: {'key_pairs'} {{(pid=117970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 22:11:17.209777 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.quota [None req-daf085d8-a8ff-4755-915a-6587f47dd463 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Getting quotas for user de021dc74a4446d8b6a63883fd56a7c4 and project 9f0ee4be50354a20baf5af85aeb4c3b2. Resources: {'key_pairs'} {{(pid=117970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 22:11:17.231788 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-daf085d8-a8ff-4755-915a-6587f47dd463 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.045230 Jun 07 22:11:17.232375 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 524/1052] 10.222.0.13 () {62 vars in 1199 bytes} [Tue Jun 7 22:11:17 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 47 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 07 22:11:17.405643 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-b804fb12-62c0-4868-8ef9-01b6055ecdac tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:11:17.406264 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-b804fb12-62c0-4868-8ef9-01b6055ecdac tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:11:17.412524 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b804fb12-62c0-4868-8ef9-01b6055ecdac tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:17.413004 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b804fb12-62c0-4868-8ef9-01b6055ecdac tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:17.413761 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b804fb12-62c0-4868-8ef9-01b6055ecdac tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:17.414190 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b804fb12-62c0-4868-8ef9-01b6055ecdac tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:17.554374 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-b804fb12-62c0-4868-8ef9-01b6055ecdac tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af02cd6ffd0484c8f6569629cd6313c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31cd38d46643fbac516d21ee4f89ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:11:17.561878 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-b804fb12-62c0-4868-8ef9-01b6055ecdac tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b" status: 200 len: 1552 microversion: 2.1 time: 0.161175 Jun 07 22:11:17.562441 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 529/1053] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:11:17 2022] GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b => generated 1552 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:11:18.526294 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-fade5426-be58-4679-9750-de21eccc6563 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2089991603", "imageRef": "87e2e140-6de8-4531-9681-d0a3e069622d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "aa5412b6-0e66-4970-af26-c42e829698c4"}], "security_groups": [{"name": "tempest-securitygroup--306141744"}], "key_name": "tempest-keypair-698275809", "user_data": "}} {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:11:18.580023 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-9e7e8e73-3fcc-4d5c-81e3-ebb5a28a5f79 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:11:18.580637 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-9e7e8e73-3fcc-4d5c-81e3-ebb5a28a5f79 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:11:18.587090 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-9e7e8e73-3fcc-4d5c-81e3-ebb5a28a5f79 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:18.587622 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-9e7e8e73-3fcc-4d5c-81e3-ebb5a28a5f79 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:18.588435 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-9e7e8e73-3fcc-4d5c-81e3-ebb5a28a5f79 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:18.588820 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-9e7e8e73-3fcc-4d5c-81e3-ebb5a28a5f79 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:18.638245 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.network.neutron [None req-fade5426-be58-4679-9750-de21eccc6563 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] validate_networks() for [('aa5412b6-0e66-4970-af26-c42e829698c4', None, None, None, None, None)] {{(pid=117970) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 22:11:18.722690 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-9e7e8e73-3fcc-4d5c-81e3-ebb5a28a5f79 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af02cd6ffd0484c8f6569629cd6313c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31cd38d46643fbac516d21ee4f89ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:11:18.730307 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-9e7e8e73-3fcc-4d5c-81e3-ebb5a28a5f79 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b" status: 200 len: 1552 microversion: 2.1 time: 0.155101 Jun 07 22:11:18.730873 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 530/1054] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:11:18 2022] GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b => generated 1552 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:11:19.196219 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.virt.hardware [None req-fade5426-be58-4679-9750-de21eccc6563 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Flavor limits 0:0:0 {{(pid=117970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 22:11:19.196704 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.virt.hardware [None req-fade5426-be58-4679-9750-de21eccc6563 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Image limits 0:0:0 {{(pid=117970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 22:11:19.197240 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.virt.hardware [None req-fade5426-be58-4679-9750-de21eccc6563 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Flavor pref 0:0:0 {{(pid=117970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 22:11:19.197711 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.virt.hardware [None req-fade5426-be58-4679-9750-de21eccc6563 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Image pref 0:0:0 {{(pid=117970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 22:11:19.198124 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.virt.hardware [None req-fade5426-be58-4679-9750-de21eccc6563 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 22:11:19.207492 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-fade5426-be58-4679-9750-de21eccc6563 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:19.207927 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-fade5426-be58-4679-9750-de21eccc6563 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:19.208711 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-fade5426-be58-4679-9750-de21eccc6563 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:19.209139 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-fade5426-be58-4679-9750-de21eccc6563 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:19.225378 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.quota [None req-fade5426-be58-4679-9750-de21eccc6563 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Getting quotas for project 9f0ee4be50354a20baf5af85aeb4c3b2. Resources: {'cores', 'ram', 'instances'} {{(pid=117970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 22:11:19.229743 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.quota [None req-fade5426-be58-4679-9750-de21eccc6563 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Getting quotas for user de021dc74a4446d8b6a63883fd56a7c4 and project 9f0ee4be50354a20baf5af85aeb4c3b2. Resources: {'cores', 'ram', 'instances'} {{(pid=117970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 22:11:19.241278 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-fade5426-be58-4679-9750-de21eccc6563 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Going to run 1 instances... {{(pid=117970) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 22:11:19.243590 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-fade5426-be58-4679-9750-de21eccc6563 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: cddfb0ad-63f6-4b0d-bf12-d388bfb0714c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='87e2e140-6de8-4531-9681-d0a3e069622d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 22:11:19.295590 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-fade5426-be58-4679-9750-de21eccc6563 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.773492 Jun 07 22:11:19.301366 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 525/1055] 10.222.0.13 () {62 vars in 1187 bytes} [Tue Jun 7 22:11:18 2022] POST /compute/v2.1/servers => generated 401 bytes in 775 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 07 22:11:19.306505 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-8200f2e3-6f11-4e16-91e7-f8e465190987 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:11:19.307448 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-8200f2e3-6f11-4e16-91e7-f8e465190987 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: cddfb0ad-63f6-4b0d-bf12-d388bfb0714c] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:11:19.365592 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-8200f2e3-6f11-4e16-91e7-f8e465190987 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:11:19.376387 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-8200f2e3-6f11-4e16-91e7-f8e465190987 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:11:19.378362 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-8200f2e3-6f11-4e16-91e7-f8e465190987 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:11:19.380676 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-8200f2e3-6f11-4e16-91e7-f8e465190987 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c" status: 200 len: 1281 microversion: 2.20 time: 0.077422 Jun 07 22:11:19.381924 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 531/1056] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:11:19 2022] GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c => generated 1281 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:11:19.461286 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [req-53d5d66e-ae47-4cf9-be9b-9f7444dbdb39 req-ea962674-c113-4d04-a65b-23d1a26aec36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbab64b0-0fb5-49d7-aeeb-d744856ddc2b", "name": "network-vif-deleted", "tag": "93fff328-2cf7-4f1c-9e4e-23777eeb1a75"}]} {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:11:19.471071 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [req-53d5d66e-ae47-4cf9-be9b-9f7444dbdb39 req-ea962674-c113-4d04-a65b-23d1a26aec36 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:19.471790 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [req-53d5d66e-ae47-4cf9-be9b-9f7444dbdb39 req-ea962674-c113-4d04-a65b-23d1a26aec36 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:19.483122 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.compute.server_external_events [req-53d5d66e-ae47-4cf9-be9b-9f7444dbdb39 req-ea962674-c113-4d04-a65b-23d1a26aec36 service nova] Creating event network-vif-deleted:93fff328-2cf7-4f1c-9e4e-23777eeb1a75 for instance fbab64b0-0fb5-49d7-aeeb-d744856ddc2b on hv-cinder-83552 Jun 07 22:11:19.489270 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [req-53d5d66e-ae47-4cf9-be9b-9f7444dbdb39 req-ea962674-c113-4d04-a65b-23d1a26aec36 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034103 Jun 07 22:11:19.489892 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 526/1057] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:11:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:11:19.747470 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-96ee043f-9054-4cf6-b4c9-ff6aae9117e5 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:11:19.748074 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-96ee043f-9054-4cf6-b4c9-ff6aae9117e5 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:11:19.754882 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-96ee043f-9054-4cf6-b4c9-ff6aae9117e5 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:19.755344 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-96ee043f-9054-4cf6-b4c9-ff6aae9117e5 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:19.756182 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-96ee043f-9054-4cf6-b4c9-ff6aae9117e5 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:19.756608 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-96ee043f-9054-4cf6-b4c9-ff6aae9117e5 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:19.792051 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-96ee043f-9054-4cf6-b4c9-ff6aae9117e5 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:19.792494 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-96ee043f-9054-4cf6-b4c9-ff6aae9117e5 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:19.792956 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.objects.instance [None req-96ee043f-9054-4cf6-b4c9-ff6aae9117e5 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lazy-loading 'fault' on Instance uuid fbab64b0-0fb5-49d7-aeeb-d744856ddc2b {{(pid=117971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 22:11:19.834474 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-96ee043f-9054-4cf6-b4c9-ff6aae9117e5 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af02cd6ffd0484c8f6569629cd6313c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31cd38d46643fbac516d21ee4f89ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:11:19.836757 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:11:19.845427 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-96ee043f-9054-4cf6-b4c9-ff6aae9117e5 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b" status: 200 len: 1347 microversion: 2.1 time: 0.101707 Jun 07 22:11:19.846098 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 532/1058] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:11:19 2022] GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b => generated 1347 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:11:20.400504 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-c4aaa970-e97a-48ea-bfb6-0500ef175b9e tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:11:20.401509 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-c4aaa970-e97a-48ea-bfb6-0500ef175b9e tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: cddfb0ad-63f6-4b0d-bf12-d388bfb0714c] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:11:20.407998 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c4aaa970-e97a-48ea-bfb6-0500ef175b9e tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:20.408442 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c4aaa970-e97a-48ea-bfb6-0500ef175b9e tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:20.409200 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c4aaa970-e97a-48ea-bfb6-0500ef175b9e tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:20.409635 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c4aaa970-e97a-48ea-bfb6-0500ef175b9e tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:20.471586 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-c4aaa970-e97a-48ea-bfb6-0500ef175b9e tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:11:20.479734 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-c4aaa970-e97a-48ea-bfb6-0500ef175b9e tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:11:20.481229 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-c4aaa970-e97a-48ea-bfb6-0500ef175b9e tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:11:20.482352 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-c4aaa970-e97a-48ea-bfb6-0500ef175b9e tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c" status: 200 len: 1333 microversion: 2.20 time: 0.086617 Jun 07 22:11:20.482897 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 527/1059] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:11:20 2022] GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c => generated 1333 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:11:20.864183 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-bf2a9240-fe35-4496-96e7-c894def2f858 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:11:20.864786 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-bf2a9240-fe35-4496-96e7-c894def2f858 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] [instance: fbab64b0-0fb5-49d7-aeeb-d744856ddc2b] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:11:20.871476 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-bf2a9240-fe35-4496-96e7-c894def2f858 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:20.871908 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-bf2a9240-fe35-4496-96e7-c894def2f858 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:20.872650 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-bf2a9240-fe35-4496-96e7-c894def2f858 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:20.873079 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-bf2a9240-fe35-4496-96e7-c894def2f858 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:20.886703 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.wsgi [None req-bf2a9240-fe35-4496-96e7-c894def2f858 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] HTTP exception thrown: Instance fbab64b0-0fb5-49d7-aeeb-d744856ddc2b could not be found. Jun 07 22:11:20.888361 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-bf2a9240-fe35-4496-96e7-c894def2f858 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Request method failure captured: Jun 07 22:11:20.888361 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: request: GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b HTTP/1.1 Jun 07 22:11:20.888361 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Accept: application/json Jun 07 22:11:20.888361 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Accept-Encoding: identity Jun 07 22:11:20.888361 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Connection: close Jun 07 22:11:20.888361 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Content-Length: 0 Jun 07 22:11:20.888361 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Content-Type: application/json Jun 07 22:11:20.888361 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Host: 10.222.0.13 Jun 07 22:11:20.888361 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Openstack-System-Scope: None Jun 07 22:11:20.888361 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: User-Agent: python-urllib3/1.26.9 Jun 07 22:11:20.888361 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Auth-Token: gAAAAABin8um5LWa0hDjlmciLFyaGnTtXNUfDugvo1YakM6gnHap0TXndc3Hr9pSWFvSCmvOXssVIFZCbWgRGsQLmK9YkT4522Fw4f5rEQz4XrHLXvdDYG0VgRJECdZSL9tIO4jgkjndFtzrOlGwB69C3TbmQdaOvfKFEtRX9MdSlBHO3LUUL_8 Jun 07 22:11:20.888361 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Domain-Id: None Jun 07 22:11:20.888361 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Domain-Name: None Jun 07 22:11:20.888361 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Identity-Status: Confirmed Jun 07 22:11:20.888361 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Is-Admin-Project: True Jun 07 22:11:20.888361 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Domain-Id: default Jun 07 22:11:20.888361 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Domain-Name: Default Jun 07 22:11:20.888361 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Id: bd31cd38d46643fbac516d21ee4f89ac Jun 07 22:11:20.888361 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Name: tempest-TestMinimumBasicScenario-1549554481 Jun 07 22:11:20.888361 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Role: member,reader Jun 07 22:11:20.888361 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Roles: member,reader Jun 07 22:11:20.889921 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/bd31cd38d46643fbac516d21ee4f89ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_bd31cd38d46643fbac516d21ee4f89ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/bd31cd38d46643fbac516d21ee4f89ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/bd31cd38d46643fbac516d21ee4f89ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}] Jun 07 22:11:20.889921 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant: tempest-TestMinimumBasicScenario-1549554481 Jun 07 22:11:20.889921 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant-Id: bd31cd38d46643fbac516d21ee4f89ac Jun 07 22:11:20.889921 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1549554481 Jun 07 22:11:20.889921 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User: tempest-TestMinimumBasicScenario-1549554481-project Jun 07 22:11:20.889921 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Domain-Id: default Jun 07 22:11:20.889921 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Domain-Name: Default Jun 07 22:11:20.889921 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Id: 7af02cd6ffd0484c8f6569629cd6313c Jun 07 22:11:20.889921 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Name: tempest-TestMinimumBasicScenario-1549554481-project Jun 07 22:11:20.889921 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: method: > Jun 07 22:11:20.889921 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: exception: Instance fbab64b0-0fb5-49d7-aeeb-d744856ddc2b could not be found. Jun 07 22:11:20.889921 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: action_args: {'id': 'fbab64b0-0fb5-49d7-aeeb-d744856ddc2b'} Jun 07 22:11:20.894069 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 22:11:20.894069 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:11:20.894069 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 22:11:20.894069 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 22:11:20.894069 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 22:11:20.894069 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 22:11:20.894069 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 22:11:20.894069 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 22:11:20.894069 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 22:11:20.894069 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 22:11:20.894069 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbab64b0-0fb5-49d7-aeeb-d744856ddc2b could not be found. Jun 07 22:11:20.894069 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:11:20.894069 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:11:20.894069 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:11:20.894069 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:11:20.894069 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:11:20.894069 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:11:20.894069 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 22:11:20.894069 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 22:11:20.894069 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 22:11:20.895702 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 22:11:20.895702 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 22:11:20.895702 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 22:11:20.895702 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 22:11:20.895702 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 22:11:20.895702 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 22:11:20.895702 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 22:11:20.895702 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbab64b0-0fb5-49d7-aeeb-d744856ddc2b could not be found. Jun 07 22:11:20.895702 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:11:20.895702 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:11:20.895702 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:11:20.895702 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:11:20.895702 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:11:20.895702 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:11:20.895702 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 22:11:20.895702 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 22:11:20.895702 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbab64b0-0fb5-49d7-aeeb-d744856ddc2b could not be found. Jun 07 22:11:20.895702 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:11:20.897006 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-bf2a9240-fe35-4496-96e7-c894def2f858 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Returning 404 to user: Instance fbab64b0-0fb5-49d7-aeeb-d744856ddc2b could not be found. {{(pid=117971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 22:11:20.897006 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-bf2a9240-fe35-4496-96e7-c894def2f858 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b" status: 404 len: 111 microversion: 2.1 time: 0.031424 Jun 07 22:11:20.897006 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 533/1060] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:11:20 2022] GET /compute/v2.1/servers/fbab64b0-0fb5-49d7-aeeb-d744856ddc2b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 22:11:20.898481 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-7f13c7a6-bd17-44af-95c7-6b23724cc314 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] Calling method '.version_select at 0x7f92f10ac700>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:11:20.918131 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-7f13c7a6-bd17-44af-95c7-6b23724cc314 tempest-TestMinimumBasicScenario-1549554481 tempest-TestMinimumBasicScenario-1549554481-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-180023907" status: 202 len: 0 microversion: 2.1 time: 0.023380 Jun 07 22:11:20.918718 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 528/1061] 10.222.0.13 () {58 vars in 1268 bytes} [Tue Jun 7 22:11:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-180023907 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 22:11:21.501084 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-b477c17f-f5c5-4b3c-bf84-446822b5f633 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:11:21.501756 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-b477c17f-f5c5-4b3c-bf84-446822b5f633 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: cddfb0ad-63f6-4b0d-bf12-d388bfb0714c] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:11:21.514087 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b477c17f-f5c5-4b3c-bf84-446822b5f633 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:21.514543 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b477c17f-f5c5-4b3c-bf84-446822b5f633 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:21.515775 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b477c17f-f5c5-4b3c-bf84-446822b5f633 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:21.516593 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b477c17f-f5c5-4b3c-bf84-446822b5f633 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:21.749922 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-b477c17f-f5c5-4b3c-bf84-446822b5f633 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:11:21.763738 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-b477c17f-f5c5-4b3c-bf84-446822b5f633 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:11:21.766430 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-b477c17f-f5c5-4b3c-bf84-446822b5f633 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:11:21.768027 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-b477c17f-f5c5-4b3c-bf84-446822b5f633 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c" status: 200 len: 1406 microversion: 2.20 time: 0.271125 Jun 07 22:11:21.768816 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 534/1062] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:11:21 2022] GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c => generated 1406 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:11:22.210296 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [req-7c9cacca-a75b-498c-bdab-f2bffd19dd42 req-9bb8c5e0-15ee-4b36-a7f0-d715f5214e66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cddfb0ad-63f6-4b0d-bf12-d388bfb0714c", "tag": "e1237eb4-3f3b-48bf-97bb-9e2c3cfc48b3"}]} {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:11:22.224769 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [req-7c9cacca-a75b-498c-bdab-f2bffd19dd42 req-9bb8c5e0-15ee-4b36-a7f0-d715f5214e66 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:22.225710 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [req-7c9cacca-a75b-498c-bdab-f2bffd19dd42 req-9bb8c5e0-15ee-4b36-a7f0-d715f5214e66 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:22.248597 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.compute.server_external_events [req-7c9cacca-a75b-498c-bdab-f2bffd19dd42 req-9bb8c5e0-15ee-4b36-a7f0-d715f5214e66 service nova] Creating event network-changed:e1237eb4-3f3b-48bf-97bb-9e2c3cfc48b3 for instance cddfb0ad-63f6-4b0d-bf12-d388bfb0714c on hv-cinder-83552 Jun 07 22:11:22.258185 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [req-7c9cacca-a75b-498c-bdab-f2bffd19dd42 req-9bb8c5e0-15ee-4b36-a7f0-d715f5214e66 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051481 Jun 07 22:11:22.259111 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 529/1063] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:11:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:11:22.787282 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-35e269e0-f898-40cf-a9ae-e3cfc694f8eb tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:11:22.787927 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-35e269e0-f898-40cf-a9ae-e3cfc694f8eb tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: cddfb0ad-63f6-4b0d-bf12-d388bfb0714c] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:11:22.795528 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-35e269e0-f898-40cf-a9ae-e3cfc694f8eb tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:22.796029 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-35e269e0-f898-40cf-a9ae-e3cfc694f8eb tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:22.797045 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-35e269e0-f898-40cf-a9ae-e3cfc694f8eb tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:22.797837 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-35e269e0-f898-40cf-a9ae-e3cfc694f8eb tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:23.224628 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-35e269e0-f898-40cf-a9ae-e3cfc694f8eb tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:11:23.232676 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-35e269e0-f898-40cf-a9ae-e3cfc694f8eb tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:11:23.234175 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-35e269e0-f898-40cf-a9ae-e3cfc694f8eb tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:11:23.235889 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-35e269e0-f898-40cf-a9ae-e3cfc694f8eb tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c" status: 200 len: 1406 microversion: 2.20 time: 0.452901 Jun 07 22:11:23.236452 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 535/1064] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:11:22 2022] GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c => generated 1406 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:11:24.255119 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-a2c81a93-c9f1-4d88-b8a0-659fd47f1ace tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:11:24.255836 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-a2c81a93-c9f1-4d88-b8a0-659fd47f1ace tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: cddfb0ad-63f6-4b0d-bf12-d388bfb0714c] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:11:24.262546 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a2c81a93-c9f1-4d88-b8a0-659fd47f1ace tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:24.262986 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a2c81a93-c9f1-4d88-b8a0-659fd47f1ace tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:24.263764 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a2c81a93-c9f1-4d88-b8a0-659fd47f1ace tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:24.264194 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a2c81a93-c9f1-4d88-b8a0-659fd47f1ace tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:24.436572 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-a2c81a93-c9f1-4d88-b8a0-659fd47f1ace tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:11:24.446634 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-a2c81a93-c9f1-4d88-b8a0-659fd47f1ace tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:11:24.451599 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-a2c81a93-c9f1-4d88-b8a0-659fd47f1ace tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:11:24.453413 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-a2c81a93-c9f1-4d88-b8a0-659fd47f1ace tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c" status: 200 len: 1406 microversion: 2.20 time: 0.202888 Jun 07 22:11:24.454192 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 530/1065] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:11:24 2022] GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c => generated 1406 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:11:25.472037 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-1af1319a-cb86-4bc0-b411-8e77a6fdf224 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:11:25.472597 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-1af1319a-cb86-4bc0-b411-8e77a6fdf224 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: cddfb0ad-63f6-4b0d-bf12-d388bfb0714c] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:11:25.479357 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-1af1319a-cb86-4bc0-b411-8e77a6fdf224 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:25.479815 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-1af1319a-cb86-4bc0-b411-8e77a6fdf224 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:25.480571 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-1af1319a-cb86-4bc0-b411-8e77a6fdf224 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:25.481010 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-1af1319a-cb86-4bc0-b411-8e77a6fdf224 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:25.618393 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-1af1319a-cb86-4bc0-b411-8e77a6fdf224 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:11:25.627795 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-1af1319a-cb86-4bc0-b411-8e77a6fdf224 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:11:25.629419 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-1af1319a-cb86-4bc0-b411-8e77a6fdf224 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:11:25.631291 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-1af1319a-cb86-4bc0-b411-8e77a6fdf224 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c" status: 200 len: 1406 microversion: 2.20 time: 0.163899 Jun 07 22:11:25.632260 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 536/1066] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:11:25 2022] GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:11:26.650080 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-015909c8-7378-4c49-9494-928d180b2539 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:11:26.650629 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-015909c8-7378-4c49-9494-928d180b2539 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: cddfb0ad-63f6-4b0d-bf12-d388bfb0714c] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:11:26.658175 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-015909c8-7378-4c49-9494-928d180b2539 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:26.658568 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-015909c8-7378-4c49-9494-928d180b2539 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:26.659349 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-015909c8-7378-4c49-9494-928d180b2539 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:26.659849 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-015909c8-7378-4c49-9494-928d180b2539 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:26.883086 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-015909c8-7378-4c49-9494-928d180b2539 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:11:26.891639 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-015909c8-7378-4c49-9494-928d180b2539 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:11:26.893152 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-015909c8-7378-4c49-9494-928d180b2539 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:11:26.894259 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-015909c8-7378-4c49-9494-928d180b2539 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c" status: 200 len: 1406 microversion: 2.20 time: 0.248217 Jun 07 22:11:26.894828 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 531/1067] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:11:26 2022] GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c => generated 1406 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:11:27.511451 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [req-bde68084-4127-446e-8b2b-1e3006940d9f req-13d5faf2-0265-4f69-afe5-109745a4d316 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cddfb0ad-63f6-4b0d-bf12-d388bfb0714c", "name": "network-vif-plugged", "status": "completed", "tag": "e1237eb4-3f3b-48bf-97bb-9e2c3cfc48b3"}]} {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:11:27.520443 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:11:27.523283 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-bde68084-4127-446e-8b2b-1e3006940d9f req-13d5faf2-0265-4f69-afe5-109745a4d316 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:27.524097 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-bde68084-4127-446e-8b2b-1e3006940d9f req-13d5faf2-0265-4f69-afe5-109745a4d316 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:27.541473 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.compute.server_external_events [req-bde68084-4127-446e-8b2b-1e3006940d9f req-13d5faf2-0265-4f69-afe5-109745a4d316 service nova] Creating event network-vif-plugged:e1237eb4-3f3b-48bf-97bb-9e2c3cfc48b3 for instance cddfb0ad-63f6-4b0d-bf12-d388bfb0714c on hv-cinder-83552 Jun 07 22:11:27.547586 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [req-bde68084-4127-446e-8b2b-1e3006940d9f req-13d5faf2-0265-4f69-afe5-109745a4d316 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039391 Jun 07 22:11:27.548560 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 537/1068] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:11:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 22:11:27.912584 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-1ac7e20b-1ab3-4cf5-968f-e9f84047b9b3 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:11:27.913302 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-1ac7e20b-1ab3-4cf5-968f-e9f84047b9b3 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: cddfb0ad-63f6-4b0d-bf12-d388bfb0714c] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:11:27.919859 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1ac7e20b-1ab3-4cf5-968f-e9f84047b9b3 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:27.920303 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1ac7e20b-1ab3-4cf5-968f-e9f84047b9b3 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:27.921061 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1ac7e20b-1ab3-4cf5-968f-e9f84047b9b3 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:27.921494 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1ac7e20b-1ab3-4cf5-968f-e9f84047b9b3 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:27.925709 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:11:28.061120 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-1ac7e20b-1ab3-4cf5-968f-e9f84047b9b3 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:11:28.069237 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-1ac7e20b-1ab3-4cf5-968f-e9f84047b9b3 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:11:28.071073 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-1ac7e20b-1ab3-4cf5-968f-e9f84047b9b3 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:11:28.072194 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-1ac7e20b-1ab3-4cf5-968f-e9f84047b9b3 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c" status: 200 len: 1406 microversion: 2.20 time: 0.163561 Jun 07 22:11:28.072767 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 532/1069] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:11:27 2022] GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:11:29.091431 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-12fe106b-2808-411f-916d-d7453f4e8192 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:11:29.092033 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-12fe106b-2808-411f-916d-d7453f4e8192 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: cddfb0ad-63f6-4b0d-bf12-d388bfb0714c] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:11:29.099770 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-12fe106b-2808-411f-916d-d7453f4e8192 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:29.100223 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-12fe106b-2808-411f-916d-d7453f4e8192 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:29.100996 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-12fe106b-2808-411f-916d-d7453f4e8192 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:29.101434 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-12fe106b-2808-411f-916d-d7453f4e8192 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:29.371829 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_cell0:SELECT=2 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:11:29.433877 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-12fe106b-2808-411f-916d-d7453f4e8192 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:11:29.442360 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-12fe106b-2808-411f-916d-d7453f4e8192 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:11:29.444310 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-12fe106b-2808-411f-916d-d7453f4e8192 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:11:29.445766 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-12fe106b-2808-411f-916d-d7453f4e8192 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c" status: 200 len: 1406 microversion: 2.20 time: 0.359071 Jun 07 22:11:29.446687 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 538/1070] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:11:29 2022] GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c => generated 1406 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:11:30.466269 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-efe059ea-0e78-49b3-a589-9602536ec61e tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:11:30.466884 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-efe059ea-0e78-49b3-a589-9602536ec61e tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: cddfb0ad-63f6-4b0d-bf12-d388bfb0714c] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:11:30.469423 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_cell0:SELECT=2 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:11:30.470197 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_cell0:SELECT=10 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:11:30.476489 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-efe059ea-0e78-49b3-a589-9602536ec61e tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:30.477199 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-efe059ea-0e78-49b3-a589-9602536ec61e tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:30.477967 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-efe059ea-0e78-49b3-a589-9602536ec61e tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:30.478404 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-efe059ea-0e78-49b3-a589-9602536ec61e tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:30.614652 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-efe059ea-0e78-49b3-a589-9602536ec61e tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:11:30.622519 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-efe059ea-0e78-49b3-a589-9602536ec61e tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:11:30.624027 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-efe059ea-0e78-49b3-a589-9602536ec61e tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:11:30.626002 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-efe059ea-0e78-49b3-a589-9602536ec61e tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c" status: 200 len: 1598 microversion: 2.20 time: 0.164107 Jun 07 22:11:30.626318 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 533/1071] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:11:30 2022] GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c => generated 1598 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:11:30.643453 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-dcfd7828-13cd-41bf-8880-dada4d970214 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:11:30.643946 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-dcfd7828-13cd-41bf-8880-dada4d970214 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: cddfb0ad-63f6-4b0d-bf12-d388bfb0714c] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:11:30.650487 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-dcfd7828-13cd-41bf-8880-dada4d970214 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:30.651319 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-dcfd7828-13cd-41bf-8880-dada4d970214 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:30.651791 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-dcfd7828-13cd-41bf-8880-dada4d970214 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:30.652224 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-dcfd7828-13cd-41bf-8880-dada4d970214 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:30.737540 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-dcfd7828-13cd-41bf-8880-dada4d970214 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.098477 Jun 07 22:11:30.743826 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 539/1072] 10.222.0.13 () {60 vars in 1315 bytes} [Tue Jun 7 22:11:30 2022] GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 22:11:31.210858 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-a4651fa3-7848-4bc9-996f-5a26a946b53d tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:11:31.211543 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-a4651fa3-7848-4bc9-996f-5a26a946b53d tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: f84b4686-8e5c-49af-b5ad-13f37e20f976] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:11:31.217805 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a4651fa3-7848-4bc9-996f-5a26a946b53d tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:31.218331 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a4651fa3-7848-4bc9-996f-5a26a946b53d tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:31.219385 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a4651fa3-7848-4bc9-996f-5a26a946b53d tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:31.219909 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a4651fa3-7848-4bc9-996f-5a26a946b53d tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:31.302435 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.objects.instance [None req-a4651fa3-7848-4bc9-996f-5a26a946b53d tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lazy-loading 'services' on Instance uuid f84b4686-8e5c-49af-b5ad-13f37e20f976 {{(pid=117970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 22:11:31.377186 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-a4651fa3-7848-4bc9-996f-5a26a946b53d tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976/os-volume_attachments/c193041b-a5dc-4a50-8b11-76dadfb0deec" status: 202 len: 0 microversion: 2.1 time: 0.171683 Jun 07 22:11:31.377893 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 534/1073] 10.222.0.13 () {58 vars in 1415 bytes} [Tue Jun 7 22:11:31 2022] DELETE /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976/os-volume_attachments/c193041b-a5dc-4a50-8b11-76dadfb0deec => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 22:11:31.386566 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-7904e472-8462-46fb-8ba0-80dd5802b0e7 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:11:31.387681 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-7904e472-8462-46fb-8ba0-80dd5802b0e7 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: f84b4686-8e5c-49af-b5ad-13f37e20f976] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:11:31.396506 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-7904e472-8462-46fb-8ba0-80dd5802b0e7 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:31.397130 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-7904e472-8462-46fb-8ba0-80dd5802b0e7 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:31.398053 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-7904e472-8462-46fb-8ba0-80dd5802b0e7 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:31.398563 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-7904e472-8462-46fb-8ba0-80dd5802b0e7 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:31.431131 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-7904e472-8462-46fb-8ba0-80dd5802b0e7 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048583 Jun 07 22:11:31.431794 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 540/1074] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jun 7 22:11:31 2022] GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:11:31.946574 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [req-2a26172f-b22a-4fe5-9a4f-08f651dd9a69 req-a077d590-5ac4-42f2-86e0-709c31d8595d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cddfb0ad-63f6-4b0d-bf12-d388bfb0714c", "tag": "e1237eb4-3f3b-48bf-97bb-9e2c3cfc48b3"}]} {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:11:31.955296 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [req-2a26172f-b22a-4fe5-9a4f-08f651dd9a69 req-a077d590-5ac4-42f2-86e0-709c31d8595d service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:31.955769 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [req-2a26172f-b22a-4fe5-9a4f-08f651dd9a69 req-a077d590-5ac4-42f2-86e0-709c31d8595d service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:31.972773 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.compute.server_external_events [req-2a26172f-b22a-4fe5-9a4f-08f651dd9a69 req-a077d590-5ac4-42f2-86e0-709c31d8595d service nova] Creating event network-changed:e1237eb4-3f3b-48bf-97bb-9e2c3cfc48b3 for instance cddfb0ad-63f6-4b0d-bf12-d388bfb0714c on hv-cinder-83552 Jun 07 22:11:31.979026 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [req-2a26172f-b22a-4fe5-9a4f-08f651dd9a69 req-a077d590-5ac4-42f2-86e0-709c31d8595d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036934 Jun 07 22:11:31.979787 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 535/1075] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:11:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:11:32.444264 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-e1eb594d-f440-4b42-8ef8-e454a0510620 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:11:32.445320 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-e1eb594d-f440-4b42-8ef8-e454a0510620 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: f84b4686-8e5c-49af-b5ad-13f37e20f976] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:11:32.454398 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e1eb594d-f440-4b42-8ef8-e454a0510620 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:32.454853 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e1eb594d-f440-4b42-8ef8-e454a0510620 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:32.455814 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e1eb594d-f440-4b42-8ef8-e454a0510620 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:32.456504 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e1eb594d-f440-4b42-8ef8-e454a0510620 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:32.496558 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-e1eb594d-f440-4b42-8ef8-e454a0510620 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057493 Jun 07 22:11:32.502295 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 541/1076] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jun 7 22:11:32 2022] GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:11:32.606618 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-e23836ad-432d-4e87-9ae5-2fdb9ce8c32f tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:11:32.607995 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-e23836ad-432d-4e87-9ae5-2fdb9ce8c32f tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:11:32.617264 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e23836ad-432d-4e87-9ae5-2fdb9ce8c32f tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:32.618080 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e23836ad-432d-4e87-9ae5-2fdb9ce8c32f tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:32.619602 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e23836ad-432d-4e87-9ae5-2fdb9ce8c32f tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:32.620262 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e23836ad-432d-4e87-9ae5-2fdb9ce8c32f tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:32.655191 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-e23836ad-432d-4e87-9ae5-2fdb9ce8c32f tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053440 Jun 07 22:11:32.655938 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 536/1077] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jun 7 22:11:32 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 07 22:11:32.722793 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-6be73846-5d1c-4654-95f8-9a27d0a69271 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:11:32.723548 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-6be73846-5d1c-4654-95f8-9a27d0a69271 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:11:32.730746 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-6be73846-5d1c-4654-95f8-9a27d0a69271 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:32.731200 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-6be73846-5d1c-4654-95f8-9a27d0a69271 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:32.732049 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-6be73846-5d1c-4654-95f8-9a27d0a69271 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:32.732707 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-6be73846-5d1c-4654-95f8-9a27d0a69271 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:32.771074 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-6be73846-5d1c-4654-95f8-9a27d0a69271 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Going to try to terminate instance {{(pid=117971) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 22:11:32.857420 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-6be73846-5d1c-4654-95f8-9a27d0a69271 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 204 len: 0 microversion: 2.1 time: 0.140224 Jun 07 22:11:32.858367 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 542/1078] 10.222.0.13 () {58 vars in 1238 bytes} [Tue Jun 7 22:11:32 2022] DELETE /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 22:11:32.867147 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-6957b59e-5348-4a40-8d9f-34e95af2163a tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:11:32.867789 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-6957b59e-5348-4a40-8d9f-34e95af2163a tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:11:32.874188 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6957b59e-5348-4a40-8d9f-34e95af2163a tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:32.875751 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6957b59e-5348-4a40-8d9f-34e95af2163a tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:32.876818 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6957b59e-5348-4a40-8d9f-34e95af2163a tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:32.877258 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6957b59e-5348-4a40-8d9f-34e95af2163a tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:33.465267 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-6957b59e-5348-4a40-8d9f-34e95af2163a tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:11:33.473381 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-6957b59e-5348-4a40-8d9f-34e95af2163a tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1670 microversion: 2.1 time: 0.610455 Jun 07 22:11:33.474315 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 537/1079] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:11:32 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1670 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:11:33.510380 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-d50c6ef9-bf3f-42a5-8896-aba72cfe5b38 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:11:33.511437 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-d50c6ef9-bf3f-42a5-8896-aba72cfe5b38 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: f84b4686-8e5c-49af-b5ad-13f37e20f976] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:11:33.518972 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-d50c6ef9-bf3f-42a5-8896-aba72cfe5b38 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:33.519363 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-d50c6ef9-bf3f-42a5-8896-aba72cfe5b38 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:33.520135 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-d50c6ef9-bf3f-42a5-8896-aba72cfe5b38 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:33.520569 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-d50c6ef9-bf3f-42a5-8896-aba72cfe5b38 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:33.564296 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-d50c6ef9-bf3f-42a5-8896-aba72cfe5b38 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058429 Jun 07 22:11:33.564922 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 543/1080] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jun 7 22:11:33 2022] GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 07 22:11:33.677732 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-b7cfd35d-3ad0-47ea-983e-54ea62f96b4b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:11:33.678531 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-b7cfd35d-3ad0-47ea-983e-54ea62f96b4b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: f84b4686-8e5c-49af-b5ad-13f37e20f976] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:11:33.686851 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-b7cfd35d-3ad0-47ea-983e-54ea62f96b4b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:33.688099 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-b7cfd35d-3ad0-47ea-983e-54ea62f96b4b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:33.689378 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-b7cfd35d-3ad0-47ea-983e-54ea62f96b4b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:33.689810 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-b7cfd35d-3ad0-47ea-983e-54ea62f96b4b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:33.722422 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-b7cfd35d-3ad0-47ea-983e-54ea62f96b4b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: f84b4686-8e5c-49af-b5ad-13f37e20f976] Going to try to terminate instance {{(pid=117970) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 22:11:33.812169 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-b7cfd35d-3ad0-47ea-983e-54ea62f96b4b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976" status: 204 len: 0 microversion: 2.1 time: 0.137225 Jun 07 22:11:33.813344 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 538/1081] 10.222.0.13 () {58 vars in 1238 bytes} [Tue Jun 7 22:11:33 2022] DELETE /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 22:11:33.823144 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-eb67965c-7677-44fb-8b27-17cefdf823ed tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:11:33.824091 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-eb67965c-7677-44fb-8b27-17cefdf823ed tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: f84b4686-8e5c-49af-b5ad-13f37e20f976] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:11:33.831893 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-eb67965c-7677-44fb-8b27-17cefdf823ed tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:33.832629 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-eb67965c-7677-44fb-8b27-17cefdf823ed tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:33.833411 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-eb67965c-7677-44fb-8b27-17cefdf823ed tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:33.834096 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-eb67965c-7677-44fb-8b27-17cefdf823ed tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:33.982965 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-eb67965c-7677-44fb-8b27-17cefdf823ed tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:11:33.991961 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-eb67965c-7677-44fb-8b27-17cefdf823ed tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976" status: 200 len: 1689 microversion: 2.1 time: 0.173853 Jun 07 22:11:33.992559 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 544/1082] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:11:33 2022] GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976 => generated 1689 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:11:34.492744 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-2fc41646-34a9-426a-b640-ab6ec99f1fd9 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:11:34.494075 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-2fc41646-34a9-426a-b640-ab6ec99f1fd9 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:11:34.500024 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-2fc41646-34a9-426a-b640-ab6ec99f1fd9 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:34.500464 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-2fc41646-34a9-426a-b640-ab6ec99f1fd9 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:34.501232 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-2fc41646-34a9-426a-b640-ab6ec99f1fd9 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:34.501672 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-2fc41646-34a9-426a-b640-ab6ec99f1fd9 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:34.786045 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-2fc41646-34a9-426a-b640-ab6ec99f1fd9 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:11:34.794967 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-2fc41646-34a9-426a-b640-ab6ec99f1fd9 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1670 microversion: 2.1 time: 0.307890 Jun 07 22:11:34.804185 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 539/1083] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:11:34 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1670 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:11:35.009410 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-d14ce11e-2f66-4b41-9429-1a8e22dc80d1 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:11:35.009960 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-d14ce11e-2f66-4b41-9429-1a8e22dc80d1 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: f84b4686-8e5c-49af-b5ad-13f37e20f976] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:11:35.023132 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-d14ce11e-2f66-4b41-9429-1a8e22dc80d1 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:35.029880 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-d14ce11e-2f66-4b41-9429-1a8e22dc80d1 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:35.033389 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-d14ce11e-2f66-4b41-9429-1a8e22dc80d1 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:35.035216 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-d14ce11e-2f66-4b41-9429-1a8e22dc80d1 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:35.214904 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-d14ce11e-2f66-4b41-9429-1a8e22dc80d1 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:11:35.225546 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-d14ce11e-2f66-4b41-9429-1a8e22dc80d1 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976" status: 200 len: 1689 microversion: 2.1 time: 0.220172 Jun 07 22:11:35.226437 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 545/1084] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:11:35 2022] GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976 => generated 1689 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:11:35.813939 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-fbfd4dcf-b918-4ae6-9855-d47df0b83983 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:11:35.814543 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-fbfd4dcf-b918-4ae6-9855-d47df0b83983 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:11:35.818879 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:11:35.832610 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-fbfd4dcf-b918-4ae6-9855-d47df0b83983 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:35.832610 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-fbfd4dcf-b918-4ae6-9855-d47df0b83983 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:35.832610 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-fbfd4dcf-b918-4ae6-9855-d47df0b83983 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:35.832610 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-fbfd4dcf-b918-4ae6-9855-d47df0b83983 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:35.979727 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-fbfd4dcf-b918-4ae6-9855-d47df0b83983 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:11:35.988869 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-fbfd4dcf-b918-4ae6-9855-d47df0b83983 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1670 microversion: 2.1 time: 0.179598 Jun 07 22:11:36.005369 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 540/1085] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:11:35 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1670 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:11:36.244465 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-25b4ab8d-114d-4e11-ada3-a6a172b90644 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:11:36.245059 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-25b4ab8d-114d-4e11-ada3-a6a172b90644 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: f84b4686-8e5c-49af-b5ad-13f37e20f976] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:11:36.252521 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-25b4ab8d-114d-4e11-ada3-a6a172b90644 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:36.253190 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-25b4ab8d-114d-4e11-ada3-a6a172b90644 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:36.254407 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-25b4ab8d-114d-4e11-ada3-a6a172b90644 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:36.254773 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-25b4ab8d-114d-4e11-ada3-a6a172b90644 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:36.479915 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-25b4ab8d-114d-4e11-ada3-a6a172b90644 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:11:36.488577 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-25b4ab8d-114d-4e11-ada3-a6a172b90644 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976" status: 200 len: 1689 microversion: 2.1 time: 0.247838 Jun 07 22:11:36.489668 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 546/1086] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:11:36 2022] GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976 => generated 1689 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:11:37.012845 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-278af03b-cbbb-4108-b427-50385c74105e tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:11:37.013448 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-278af03b-cbbb-4108-b427-50385c74105e tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:11:37.021809 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-278af03b-cbbb-4108-b427-50385c74105e tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:37.022602 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-278af03b-cbbb-4108-b427-50385c74105e tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:37.023405 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-278af03b-cbbb-4108-b427-50385c74105e tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:37.023822 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-278af03b-cbbb-4108-b427-50385c74105e tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:37.169816 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-278af03b-cbbb-4108-b427-50385c74105e tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:11:37.179319 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-278af03b-cbbb-4108-b427-50385c74105e tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1670 microversion: 2.1 time: 0.170852 Jun 07 22:11:37.198591 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 541/1087] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:11:37 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1670 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:11:37.506993 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-e08f460a-31cb-4850-9002-28dcd6c1cef3 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:11:37.507742 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-e08f460a-31cb-4850-9002-28dcd6c1cef3 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: f84b4686-8e5c-49af-b5ad-13f37e20f976] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:11:37.522908 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e08f460a-31cb-4850-9002-28dcd6c1cef3 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:37.523527 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e08f460a-31cb-4850-9002-28dcd6c1cef3 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:37.524397 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e08f460a-31cb-4850-9002-28dcd6c1cef3 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:37.524914 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e08f460a-31cb-4850-9002-28dcd6c1cef3 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:37.806611 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-e08f460a-31cb-4850-9002-28dcd6c1cef3 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:11:37.816701 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-e08f460a-31cb-4850-9002-28dcd6c1cef3 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976" status: 200 len: 1689 microversion: 2.1 time: 0.314294 Jun 07 22:11:37.817892 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 547/1088] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:11:37 2022] GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976 => generated 1689 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:11:38.203566 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-b45f591c-6c05-438a-98cd-eb424e61a71f tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:11:38.204866 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-b45f591c-6c05-438a-98cd-eb424e61a71f tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:11:38.216173 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-b45f591c-6c05-438a-98cd-eb424e61a71f tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:38.216915 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-b45f591c-6c05-438a-98cd-eb424e61a71f tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:38.217917 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-b45f591c-6c05-438a-98cd-eb424e61a71f tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:38.218655 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-b45f591c-6c05-438a-98cd-eb424e61a71f tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:38.835715 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-2a508669-0850-4f65-8c21-399e965edbde tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:11:38.838351 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-2a508669-0850-4f65-8c21-399e965edbde tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: f84b4686-8e5c-49af-b5ad-13f37e20f976] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:11:38.855742 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-2a508669-0850-4f65-8c21-399e965edbde tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:38.856933 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-2a508669-0850-4f65-8c21-399e965edbde tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:38.858843 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-2a508669-0850-4f65-8c21-399e965edbde tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:38.861142 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-2a508669-0850-4f65-8c21-399e965edbde tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:38.882317 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-b45f591c-6c05-438a-98cd-eb424e61a71f tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:11:38.894290 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-b45f591c-6c05-438a-98cd-eb424e61a71f tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1670 microversion: 2.1 time: 0.699873 Jun 07 22:11:38.911882 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 542/1089] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:11:38 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1670 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:11:39.213796 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-2a508669-0850-4f65-8c21-399e965edbde tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:11:39.223441 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-2a508669-0850-4f65-8c21-399e965edbde tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976" status: 200 len: 1622 microversion: 2.1 time: 0.392347 Jun 07 22:11:39.235683 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 548/1090] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:11:38 2022] GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976 => generated 1622 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:11:39.713490 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [req-6db5b280-9caa-4119-a893-77f65c62e9f0 req-09b12726-549d-45ae-ad04-1eb34476645e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f84b4686-8e5c-49af-b5ad-13f37e20f976", "name": "network-vif-deleted", "tag": "3d9f0611-4530-459f-983c-a70170e27b7f"}]} {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:11:39.753987 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [req-6db5b280-9caa-4119-a893-77f65c62e9f0 req-09b12726-549d-45ae-ad04-1eb34476645e service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:39.754958 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [req-6db5b280-9caa-4119-a893-77f65c62e9f0 req-09b12726-549d-45ae-ad04-1eb34476645e service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:39.776253 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.compute.server_external_events [req-6db5b280-9caa-4119-a893-77f65c62e9f0 req-09b12726-549d-45ae-ad04-1eb34476645e service nova] Creating event network-vif-deleted:3d9f0611-4530-459f-983c-a70170e27b7f for instance f84b4686-8e5c-49af-b5ad-13f37e20f976 on hv-cinder-83552 Jun 07 22:11:39.786970 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [req-6db5b280-9caa-4119-a893-77f65c62e9f0 req-09b12726-549d-45ae-ad04-1eb34476645e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076701 Jun 07 22:11:39.787644 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 543/1091] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:11:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 22:11:39.918504 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-a7459204-fc0d-4556-b566-a3fc1ced9cc5 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:11:39.920400 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-a7459204-fc0d-4556-b566-a3fc1ced9cc5 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:11:39.929289 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a7459204-fc0d-4556-b566-a3fc1ced9cc5 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:39.929916 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a7459204-fc0d-4556-b566-a3fc1ced9cc5 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:39.931188 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a7459204-fc0d-4556-b566-a3fc1ced9cc5 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:39.931801 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a7459204-fc0d-4556-b566-a3fc1ced9cc5 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:39.964138 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:11:40.106688 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-a7459204-fc0d-4556-b566-a3fc1ced9cc5 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:11:40.141467 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-a7459204-fc0d-4556-b566-a3fc1ced9cc5 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1320 microversion: 2.1 time: 0.226130 Jun 07 22:11:40.142674 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 549/1092] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:11:39 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1320 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:11:40.241786 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-4fa17db5-cf16-4f6f-bee7-cdf3b05f2e2c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:11:40.242787 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-4fa17db5-cf16-4f6f-bee7-cdf3b05f2e2c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: f84b4686-8e5c-49af-b5ad-13f37e20f976] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:11:40.278454 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4fa17db5-cf16-4f6f-bee7-cdf3b05f2e2c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:40.278884 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4fa17db5-cf16-4f6f-bee7-cdf3b05f2e2c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:40.279697 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4fa17db5-cf16-4f6f-bee7-cdf3b05f2e2c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:40.280262 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4fa17db5-cf16-4f6f-bee7-cdf3b05f2e2c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:40.377018 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4fa17db5-cf16-4f6f-bee7-cdf3b05f2e2c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:40.377472 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4fa17db5-cf16-4f6f-bee7-cdf3b05f2e2c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:40.377934 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.objects.instance [None req-4fa17db5-cf16-4f6f-bee7-cdf3b05f2e2c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lazy-loading 'fault' on Instance uuid f84b4686-8e5c-49af-b5ad-13f37e20f976 {{(pid=117970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 22:11:40.539094 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-4fa17db5-cf16-4f6f-bee7-cdf3b05f2e2c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:11:40.552051 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-4fa17db5-cf16-4f6f-bee7-cdf3b05f2e2c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976" status: 200 len: 1335 microversion: 2.1 time: 0.314109 Jun 07 22:11:40.553193 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 544/1093] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:11:40 2022] GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976 => generated 1335 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:11:41.163624 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-7e078761-1ba0-4afb-987c-a034c6357bc2 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:11:41.164898 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-7e078761-1ba0-4afb-987c-a034c6357bc2 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:11:41.181205 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-7e078761-1ba0-4afb-987c-a034c6357bc2 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:41.181929 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-7e078761-1ba0-4afb-987c-a034c6357bc2 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:41.182932 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-7e078761-1ba0-4afb-987c-a034c6357bc2 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:41.183562 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-7e078761-1ba0-4afb-987c-a034c6357bc2 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:41.258418 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-7e078761-1ba0-4afb-987c-a034c6357bc2 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:41.259116 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-7e078761-1ba0-4afb-987c-a034c6357bc2 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:41.259762 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.objects.instance [None req-7e078761-1ba0-4afb-987c-a034c6357bc2 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lazy-loading 'fault' on Instance uuid f29be694-507c-48eb-9fdd-d20bef8f6609 {{(pid=117971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 22:11:41.451861 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-7e078761-1ba0-4afb-987c-a034c6357bc2 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:11:41.464537 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-7e078761-1ba0-4afb-987c-a034c6357bc2 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 200 len: 1325 microversion: 2.1 time: 0.307612 Jun 07 22:11:41.466583 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 550/1094] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:11:41 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 1325 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:11:41.572357 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-911b0f21-e6d6-45d8-9067-f53e1cfb6b09 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:11:41.573640 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-911b0f21-e6d6-45d8-9067-f53e1cfb6b09 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: f84b4686-8e5c-49af-b5ad-13f37e20f976] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:11:41.593509 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-911b0f21-e6d6-45d8-9067-f53e1cfb6b09 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:41.596404 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-911b0f21-e6d6-45d8-9067-f53e1cfb6b09 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:41.599098 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-911b0f21-e6d6-45d8-9067-f53e1cfb6b09 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:41.603406 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-911b0f21-e6d6-45d8-9067-f53e1cfb6b09 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:41.637756 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.wsgi [None req-911b0f21-e6d6-45d8-9067-f53e1cfb6b09 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] HTTP exception thrown: Instance f84b4686-8e5c-49af-b5ad-13f37e20f976 could not be found. Jun 07 22:11:41.642855 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-911b0f21-e6d6-45d8-9067-f53e1cfb6b09 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Request method failure captured: Jun 07 22:11:41.642855 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: request: GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976 HTTP/1.1 Jun 07 22:11:41.642855 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Accept: application/json Jun 07 22:11:41.642855 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Accept-Encoding: identity Jun 07 22:11:41.642855 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Connection: close Jun 07 22:11:41.642855 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Content-Length: 0 Jun 07 22:11:41.642855 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Content-Type: application/json Jun 07 22:11:41.642855 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Host: 10.222.0.13 Jun 07 22:11:41.642855 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Openstack-System-Scope: None Jun 07 22:11:41.642855 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: User-Agent: python-urllib3/1.26.9 Jun 07 22:11:41.642855 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Auth-Token: gAAAAABin8sikwri0wz--bbwCQiRTo8aflsbVudHe_idy05qCCCm6kMV6CqJhWmtBn1AnbEoV22lfFfBtXzCrxKFJsUQou-LO31msxwdCukOro2yUZ7Ru7Jq7nfvAeg5tmJuzphYSRHzoedKYtMoC-7_d00L6jKIA57HYnc7FI-lfgXXUmmTM04 Jun 07 22:11:41.642855 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Domain-Id: None Jun 07 22:11:41.642855 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Domain-Name: None Jun 07 22:11:41.642855 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Identity-Status: Confirmed Jun 07 22:11:41.642855 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Is-Admin-Project: True Jun 07 22:11:41.642855 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Domain-Id: default Jun 07 22:11:41.642855 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Domain-Name: Default Jun 07 22:11:41.642855 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Id: 0a4fc48a5efe4d8b974757a5bf7d947e Jun 07 22:11:41.642855 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-676703940 Jun 07 22:11:41.642855 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Role: member,reader Jun 07 22:11:41.642855 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Roles: member,reader Jun 07 22:11:41.644569 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0a4fc48a5efe4d8b974757a5bf7d947e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_0a4fc48a5efe4d8b974757a5bf7d947e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0a4fc48a5efe4d8b974757a5bf7d947e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/0a4fc48a5efe4d8b974757a5bf7d947e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}] Jun 07 22:11:41.644569 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Tenant: tempest-ServerRescueNegativeTestJSON-676703940 Jun 07 22:11:41.644569 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Tenant-Id: 0a4fc48a5efe4d8b974757a5bf7d947e Jun 07 22:11:41.644569 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-676703940 Jun 07 22:11:41.644569 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User: tempest-ServerRescueNegativeTestJSON-676703940-project Jun 07 22:11:41.644569 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Domain-Id: default Jun 07 22:11:41.644569 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Domain-Name: Default Jun 07 22:11:41.644569 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Id: c44c1788959e4b339c9cd5aad4318496 Jun 07 22:11:41.644569 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Name: tempest-ServerRescueNegativeTestJSON-676703940-project Jun 07 22:11:41.644569 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: method: > Jun 07 22:11:41.644569 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: exception: Instance f84b4686-8e5c-49af-b5ad-13f37e20f976 could not be found. Jun 07 22:11:41.644569 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: action_args: {'id': 'f84b4686-8e5c-49af-b5ad-13f37e20f976'} Jun 07 22:11:41.645469 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 22:11:41.645469 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:11:41.645469 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 22:11:41.645469 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 22:11:41.645469 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 22:11:41.645469 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 22:11:41.645469 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 22:11:41.645469 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 22:11:41.645469 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 22:11:41.645469 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 22:11:41.645469 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f84b4686-8e5c-49af-b5ad-13f37e20f976 could not be found. Jun 07 22:11:41.645469 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:11:41.645469 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:11:41.645469 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:11:41.645469 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:11:41.645469 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:11:41.645469 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:11:41.645469 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 22:11:41.645469 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 22:11:41.645469 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 22:11:41.646921 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 22:11:41.646921 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 22:11:41.646921 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 22:11:41.646921 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 22:11:41.646921 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 22:11:41.646921 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 22:11:41.646921 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 22:11:41.646921 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f84b4686-8e5c-49af-b5ad-13f37e20f976 could not be found. Jun 07 22:11:41.646921 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:11:41.646921 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:11:41.646921 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:11:41.646921 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:11:41.646921 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:11:41.646921 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:11:41.646921 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 22:11:41.646921 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 22:11:41.646921 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f84b4686-8e5c-49af-b5ad-13f37e20f976 could not be found. Jun 07 22:11:41.646921 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:11:41.649493 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-911b0f21-e6d6-45d8-9067-f53e1cfb6b09 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Returning 404 to user: Instance f84b4686-8e5c-49af-b5ad-13f37e20f976 could not be found. {{(pid=117970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 22:11:41.652224 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-911b0f21-e6d6-45d8-9067-f53e1cfb6b09 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976" status: 404 len: 111 microversion: 2.1 time: 0.086468 Jun 07 22:11:41.653446 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 545/1095] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:11:41 2022] GET /compute/v2.1/servers/f84b4686-8e5c-49af-b5ad-13f37e20f976 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 22:11:41.664089 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-28343e47-6993-4d41-a693-8bcfda261922 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '.version_select at 0x7f92f13fbaf0>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:11:41.699910 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-28343e47-6993-4d41-a693-8bcfda261922 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-229823501" status: 202 len: 0 microversion: 2.1 time: 0.040859 Jun 07 22:11:41.701498 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 551/1096] 10.222.0.13 () {58 vars in 1217 bytes} [Tue Jun 7 22:11:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-229823501 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 22:11:41.863503 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [req-9b5b1de0-76a6-4d8a-9b3b-86cbdcef3cdf req-4d4365f5-0c17-4349-9e24-c193e8b37e13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f29be694-507c-48eb-9fdd-d20bef8f6609", "name": "network-vif-deleted", "tag": "b5e13943-f98b-44ed-aa48-c5263e7a75d2"}]} {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:11:41.881977 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [req-9b5b1de0-76a6-4d8a-9b3b-86cbdcef3cdf req-4d4365f5-0c17-4349-9e24-c193e8b37e13 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:41.886230 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [req-9b5b1de0-76a6-4d8a-9b3b-86cbdcef3cdf req-4d4365f5-0c17-4349-9e24-c193e8b37e13 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:41.917165 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.compute.server_external_events [req-9b5b1de0-76a6-4d8a-9b3b-86cbdcef3cdf req-4d4365f5-0c17-4349-9e24-c193e8b37e13 service nova] Creating event network-vif-deleted:b5e13943-f98b-44ed-aa48-c5263e7a75d2 for instance f29be694-507c-48eb-9fdd-d20bef8f6609 on hv-cinder-83552 Jun 07 22:11:41.932946 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [req-9b5b1de0-76a6-4d8a-9b3b-86cbdcef3cdf req-4d4365f5-0c17-4349-9e24-c193e8b37e13 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074166 Jun 07 22:11:41.933463 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 546/1097] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:11:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:11:42.504344 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-03c3d0ca-0fcb-45ff-9a7c-7b364ae27c88 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:11:42.506628 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-03c3d0ca-0fcb-45ff-9a7c-7b364ae27c88 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:11:42.515546 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-03c3d0ca-0fcb-45ff-9a7c-7b364ae27c88 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:42.516450 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-03c3d0ca-0fcb-45ff-9a7c-7b364ae27c88 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:42.517457 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-03c3d0ca-0fcb-45ff-9a7c-7b364ae27c88 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:42.518249 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-03c3d0ca-0fcb-45ff-9a7c-7b364ae27c88 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:42.546944 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.wsgi [None req-03c3d0ca-0fcb-45ff-9a7c-7b364ae27c88 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] HTTP exception thrown: Instance f29be694-507c-48eb-9fdd-d20bef8f6609 could not be found. Jun 07 22:11:42.548758 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-03c3d0ca-0fcb-45ff-9a7c-7b364ae27c88 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Request method failure captured: Jun 07 22:11:42.548758 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: request: GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 HTTP/1.1 Jun 07 22:11:42.548758 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Accept: application/json Jun 07 22:11:42.548758 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Accept-Encoding: identity Jun 07 22:11:42.548758 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Connection: close Jun 07 22:11:42.548758 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Content-Length: 0 Jun 07 22:11:42.548758 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Content-Type: application/json Jun 07 22:11:42.548758 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Host: 10.222.0.13 Jun 07 22:11:42.548758 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Openstack-System-Scope: None Jun 07 22:11:42.548758 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: User-Agent: python-urllib3/1.26.9 Jun 07 22:11:42.548758 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Auth-Token: gAAAAABin8stFnSMxrhT84EXIXg15dNZm3Gd2ykjx38HfSUx0lJsugvPTyPdpw3Tz6k88_OYtoshuwGwdqYNoYAViMeGgt0DiBqvlGNzpOWfMHV1_871Sx-8V9C-sw_a6H3vbGtS3KWJgFbLpzr_Hma8mRUqSKW5EPbeOn9lfv_84fRIgRu2c_4 Jun 07 22:11:42.548758 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Domain-Id: None Jun 07 22:11:42.548758 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Domain-Name: None Jun 07 22:11:42.548758 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Identity-Status: Confirmed Jun 07 22:11:42.548758 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Is-Admin-Project: True Jun 07 22:11:42.548758 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Domain-Id: default Jun 07 22:11:42.548758 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Domain-Name: Default Jun 07 22:11:42.548758 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Id: d32f58b7303541388483ca4b881a552e Jun 07 22:11:42.548758 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Name: tempest-AttachVolumeTestJSON-1459522994 Jun 07 22:11:42.548758 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Role: member,reader Jun 07 22:11:42.548758 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Roles: member,reader Jun 07 22:11:42.550490 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d32f58b7303541388483ca4b881a552e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_d32f58b7303541388483ca4b881a552e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d32f58b7303541388483ca4b881a552e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/d32f58b7303541388483ca4b881a552e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}] Jun 07 22:11:42.550490 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant: tempest-AttachVolumeTestJSON-1459522994 Jun 07 22:11:42.550490 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant-Id: d32f58b7303541388483ca4b881a552e Jun 07 22:11:42.550490 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1459522994 Jun 07 22:11:42.550490 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User: tempest-AttachVolumeTestJSON-1459522994-project Jun 07 22:11:42.550490 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Domain-Id: default Jun 07 22:11:42.550490 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Domain-Name: Default Jun 07 22:11:42.550490 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Id: 0e68eff6a08d4193b3167d47f4e1f97c Jun 07 22:11:42.550490 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Name: tempest-AttachVolumeTestJSON-1459522994-project Jun 07 22:11:42.550490 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: method: > Jun 07 22:11:42.550490 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: exception: Instance f29be694-507c-48eb-9fdd-d20bef8f6609 could not be found. Jun 07 22:11:42.550490 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: action_args: {'id': 'f29be694-507c-48eb-9fdd-d20bef8f6609'} Jun 07 22:11:42.551465 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 22:11:42.551465 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:11:42.551465 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 22:11:42.551465 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 22:11:42.551465 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 22:11:42.551465 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 22:11:42.551465 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 22:11:42.551465 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 22:11:42.551465 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 22:11:42.551465 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 22:11:42.551465 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f29be694-507c-48eb-9fdd-d20bef8f6609 could not be found. Jun 07 22:11:42.551465 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:11:42.551465 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:11:42.551465 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:11:42.551465 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:11:42.551465 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:11:42.551465 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:11:42.551465 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 22:11:42.551465 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 22:11:42.551465 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 22:11:42.552922 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 22:11:42.552922 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 22:11:42.552922 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 22:11:42.552922 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 22:11:42.552922 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 22:11:42.552922 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 22:11:42.552922 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 22:11:42.552922 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f29be694-507c-48eb-9fdd-d20bef8f6609 could not be found. Jun 07 22:11:42.552922 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:11:42.552922 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:11:42.552922 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:11:42.552922 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:11:42.552922 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:11:42.552922 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:11:42.552922 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 22:11:42.552922 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 22:11:42.552922 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f29be694-507c-48eb-9fdd-d20bef8f6609 could not be found. Jun 07 22:11:42.552922 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:11:42.554227 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-03c3d0ca-0fcb-45ff-9a7c-7b364ae27c88 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Returning 404 to user: Instance f29be694-507c-48eb-9fdd-d20bef8f6609 could not be found. {{(pid=117971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 22:11:42.554227 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-03c3d0ca-0fcb-45ff-9a7c-7b364ae27c88 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 404 len: 111 microversion: 2.1 time: 0.073669 Jun 07 22:11:42.557824 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 552/1098] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:11:42 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 22:11:42.567723 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-160a250e-ccd4-472a-bfc2-bd434914465f tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '.version_select at 0x7f92f1fad940>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:11:42.594927 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-160a250e-ccd4-472a-bfc2-bd434914465f tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-406503496" status: 202 len: 0 microversion: 2.1 time: 0.034045 Jun 07 22:11:42.599269 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 553/1099] 10.222.0.13 () {58 vars in 1217 bytes} [Tue Jun 7 22:11:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-406503496 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 22:11:42.809195 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-d4f4f58f-ea17-4355-88ee-74eb8839a4c4 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Action: 'create', calling method: .version_select at 0x7f92f65b2e50>, body: {"keypair": {"name": "tempest-TestShelveInstance-813171803", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKdfFS1YTxyQqMnuZrODnzVKph+Su/Q9HynJaFaMQZe4bujB0hADRxIGvOTUVT0ePHq8ZEY3HTYYs97sVQIQHPcgK54mHdhCXTb3nfSGqU1e0DdccvDIKoe+GKnW2bWkmA=="}} {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:11:42.827013 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.quota [None req-d4f4f58f-ea17-4355-88ee-74eb8839a4c4 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Getting quotas for project 98914183afee4e58ad7a425cb019e639. Resources: {'key_pairs'} {{(pid=117970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 22:11:42.832705 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.quota [None req-d4f4f58f-ea17-4355-88ee-74eb8839a4c4 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Getting quotas for user 7e8c46b1820a4ce5ac853ab1cc88fc30 and project 98914183afee4e58ad7a425cb019e639. Resources: {'key_pairs'} {{(pid=117970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 22:11:42.866921 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-d4f4f58f-ea17-4355-88ee-74eb8839a4c4 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.373035 Jun 07 22:11:42.873971 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 547/1100] 10.222.0.13 () {60 vars in 1158 bytes} [Tue Jun 7 22:11:42 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:11:43.703761 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-bd6833a4-bdc6-4bbb-8e8b-551471f4a409 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Action: 'create', calling method: .version_select at 0x7f92f13f6a60>, body: {"keypair": {"name": "tempest-keypair-329874958", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+L+kSqLa5AApbGD9MneJu+0vYht6yC0FT4AElrgQKZXK5Jb92G4OvSdyq4rs+zf5z9vcTo0x+SO80F1do89Xv6jjfcmxa/RYd7xnnzA5SsJ/5NP+Tu9c8qZ24HncRBhg=="}} {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:11:43.731188 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.quota [None req-bd6833a4-bdc6-4bbb-8e8b-551471f4a409 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Getting quotas for project d32f58b7303541388483ca4b881a552e. Resources: {'key_pairs'} {{(pid=117971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 22:11:43.735990 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.quota [None req-bd6833a4-bdc6-4bbb-8e8b-551471f4a409 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Getting quotas for user 0e68eff6a08d4193b3167d47f4e1f97c and project d32f58b7303541388483ca4b881a552e. Resources: {'key_pairs'} {{(pid=117971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 22:11:43.777468 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-bd6833a4-bdc6-4bbb-8e8b-551471f4a409 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.078060 Jun 07 22:11:43.786222 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 554/1101] 10.222.0.13 () {60 vars in 1158 bytes} [Tue Jun 7 22:11:43 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:11:45.035532 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-ba0249e0-cbaf-4fcf-95bd-902c06e5dd44 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:11:45.036163 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-ba0249e0-cbaf-4fcf-95bd-902c06e5dd44 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:11:45.044603 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-ba0249e0-cbaf-4fcf-95bd-902c06e5dd44 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:45.045060 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-ba0249e0-cbaf-4fcf-95bd-902c06e5dd44 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:45.045834 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-ba0249e0-cbaf-4fcf-95bd-902c06e5dd44 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:45.046301 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-ba0249e0-cbaf-4fcf-95bd-902c06e5dd44 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:45.084966 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-ba0249e0-cbaf-4fcf-95bd-902c06e5dd44 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Going to try to terminate instance {{(pid=117970) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 22:11:45.127239 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:11:45.212773 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-ba0249e0-cbaf-4fcf-95bd-902c06e5dd44 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "DELETE /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 204 len: 0 microversion: 2.1 time: 0.181525 Jun 07 22:11:45.213824 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 548/1102] 10.222.0.13 () {58 vars in 1238 bytes} [Tue Jun 7 22:11:45 2022] DELETE /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 22:11:45.223130 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-1ab673a2-33d1-4a9a-ac8c-b0040ddaff68 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:11:45.224398 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-1ab673a2-33d1-4a9a-ac8c-b0040ddaff68 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:11:45.233349 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-1ab673a2-33d1-4a9a-ac8c-b0040ddaff68 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:45.234247 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-1ab673a2-33d1-4a9a-ac8c-b0040ddaff68 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:45.235465 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-1ab673a2-33d1-4a9a-ac8c-b0040ddaff68 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:45.236254 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-1ab673a2-33d1-4a9a-ac8c-b0040ddaff68 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:45.506837 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-1ab673a2-33d1-4a9a-ac8c-b0040ddaff68 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:11:45.525382 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-1ab673a2-33d1-4a9a-ac8c-b0040ddaff68 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1507 microversion: 2.1 time: 0.307080 Jun 07 22:11:45.526456 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 555/1103] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:11:45 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1507 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:11:45.797992 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-bf32f4c4-a9b4-4750-bcc3-5a603ef9f0f0 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-502106166", "imageRef": "87e2e140-6de8-4531-9681-d0a3e069622d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fb5585d7-4dbe-44e8-b38e-d8afe1080b96"}], "security_groups": [{"name": "tempest-securitygroup--1908206926"}], "key_name": "tempest-keypair-329874958", "user_data": "}} {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:11:45.907175 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.network.neutron [None req-bf32f4c4-a9b4-4750-bcc3-5a603ef9f0f0 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] validate_networks() for [('fb5585d7-4dbe-44e8-b38e-d8afe1080b96', None, None, None, None, None)] {{(pid=117970) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 22:11:46.322290 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.virt.hardware [None req-bf32f4c4-a9b4-4750-bcc3-5a603ef9f0f0 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Flavor limits 0:0:0 {{(pid=117970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 22:11:46.322855 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.virt.hardware [None req-bf32f4c4-a9b4-4750-bcc3-5a603ef9f0f0 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Image limits 0:0:0 {{(pid=117970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 22:11:46.323263 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.virt.hardware [None req-bf32f4c4-a9b4-4750-bcc3-5a603ef9f0f0 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Flavor pref 0:0:0 {{(pid=117970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 22:11:46.323703 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.virt.hardware [None req-bf32f4c4-a9b4-4750-bcc3-5a603ef9f0f0 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Image pref 0:0:0 {{(pid=117970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 22:11:46.324111 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.virt.hardware [None req-bf32f4c4-a9b4-4750-bcc3-5a603ef9f0f0 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 22:11:46.333444 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-bf32f4c4-a9b4-4750-bcc3-5a603ef9f0f0 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:46.333891 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-bf32f4c4-a9b4-4750-bcc3-5a603ef9f0f0 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:46.334684 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-bf32f4c4-a9b4-4750-bcc3-5a603ef9f0f0 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:46.335117 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-bf32f4c4-a9b4-4750-bcc3-5a603ef9f0f0 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:46.353442 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.quota [None req-bf32f4c4-a9b4-4750-bcc3-5a603ef9f0f0 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Getting quotas for project d32f58b7303541388483ca4b881a552e. Resources: {'cores', 'ram', 'instances'} {{(pid=117970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 22:11:46.357385 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.quota [None req-bf32f4c4-a9b4-4750-bcc3-5a603ef9f0f0 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Getting quotas for user 0e68eff6a08d4193b3167d47f4e1f97c and project d32f58b7303541388483ca4b881a552e. Resources: {'cores', 'ram', 'instances'} {{(pid=117970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 22:11:46.370111 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-bf32f4c4-a9b4-4750-bcc3-5a603ef9f0f0 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Going to run 1 instances... {{(pid=117970) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 22:11:46.372532 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-bf32f4c4-a9b4-4750-bcc3-5a603ef9f0f0 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: c00b6e50-3d0c-4614-bf39-f36ae4169292] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='87e2e140-6de8-4531-9681-d0a3e069622d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 22:11:46.422295 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-bf32f4c4-a9b4-4750-bcc3-5a603ef9f0f0 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.629118 Jun 07 22:11:46.423165 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 549/1104] 10.222.0.13 () {60 vars in 1146 bytes} [Tue Jun 7 22:11:45 2022] POST /compute/v2.1/servers => generated 402 bytes in 631 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 22:11:46.435817 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-5885d121-c5e8-46f9-9fad-4dae74bc0eae tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:11:46.436428 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-5885d121-c5e8-46f9-9fad-4dae74bc0eae tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: c00b6e50-3d0c-4614-bf39-f36ae4169292] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:11:46.505517 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-5885d121-c5e8-46f9-9fad-4dae74bc0eae tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:11:46.512693 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-5885d121-c5e8-46f9-9fad-4dae74bc0eae tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/c00b6e50-3d0c-4614-bf39-f36ae4169292" status: 200 len: 1236 microversion: 2.1 time: 0.082983 Jun 07 22:11:46.513260 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 556/1105] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:11:46 2022] GET /compute/v2.1/servers/c00b6e50-3d0c-4614-bf39-f36ae4169292 => generated 1236 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:11:46.542027 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-3737ce3e-05bc-490a-a41c-4d97b5cd9afa tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:11:46.542775 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-3737ce3e-05bc-490a-a41c-4d97b5cd9afa tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:11:46.550766 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-3737ce3e-05bc-490a-a41c-4d97b5cd9afa tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:46.551319 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-3737ce3e-05bc-490a-a41c-4d97b5cd9afa tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:46.552371 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-3737ce3e-05bc-490a-a41c-4d97b5cd9afa tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:46.553033 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-3737ce3e-05bc-490a-a41c-4d97b5cd9afa tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:46.761544 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-3737ce3e-05bc-490a-a41c-4d97b5cd9afa tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:11:46.771022 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-3737ce3e-05bc-490a-a41c-4d97b5cd9afa tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1507 microversion: 2.1 time: 0.232735 Jun 07 22:11:46.772321 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 550/1106] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:11:46 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1507 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:11:46.892860 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [req-48c34ad0-629c-40d0-a280-2e6e8c2ac052 req-d69f4ea6-19fa-477b-9265-6be6fa7ea31b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73af9eba-632b-4035-a6ad-02f4fa11866a", "name": "network-vif-deleted", "tag": "7d1a50e0-bf7e-4a2c-a985-08a1f47ed1d2"}]} {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:11:46.906885 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-48c34ad0-629c-40d0-a280-2e6e8c2ac052 req-d69f4ea6-19fa-477b-9265-6be6fa7ea31b service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:46.907356 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-48c34ad0-629c-40d0-a280-2e6e8c2ac052 req-d69f4ea6-19fa-477b-9265-6be6fa7ea31b service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:46.920809 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.compute.server_external_events [req-48c34ad0-629c-40d0-a280-2e6e8c2ac052 req-d69f4ea6-19fa-477b-9265-6be6fa7ea31b service nova] Creating event network-vif-deleted:7d1a50e0-bf7e-4a2c-a985-08a1f47ed1d2 for instance 73af9eba-632b-4035-a6ad-02f4fa11866a on hv-cinder-83552 Jun 07 22:11:46.927742 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [req-48c34ad0-629c-40d0-a280-2e6e8c2ac052 req-d69f4ea6-19fa-477b-9265-6be6fa7ea31b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040441 Jun 07 22:11:46.929021 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 557/1107] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:11:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:11:47.530170 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-0b23e3a4-2db2-43c6-a97e-42595237983b tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:11:47.530792 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-0b23e3a4-2db2-43c6-a97e-42595237983b tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: c00b6e50-3d0c-4614-bf39-f36ae4169292] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:11:47.540384 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0b23e3a4-2db2-43c6-a97e-42595237983b tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:47.541496 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0b23e3a4-2db2-43c6-a97e-42595237983b tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:47.542325 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0b23e3a4-2db2-43c6-a97e-42595237983b tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:47.542765 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0b23e3a4-2db2-43c6-a97e-42595237983b tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:47.607245 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-0b23e3a4-2db2-43c6-a97e-42595237983b tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:11:47.615652 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-0b23e3a4-2db2-43c6-a97e-42595237983b tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/c00b6e50-3d0c-4614-bf39-f36ae4169292" status: 200 len: 1288 microversion: 2.1 time: 0.089375 Jun 07 22:11:47.616224 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 551/1108] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:11:47 2022] GET /compute/v2.1/servers/c00b6e50-3d0c-4614-bf39-f36ae4169292 => generated 1288 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:11:47.790540 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-9fb7389d-a3c4-4fd9-8829-c3d366fd03c1 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:11:47.792163 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-9fb7389d-a3c4-4fd9-8829-c3d366fd03c1 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:11:47.803276 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-9fb7389d-a3c4-4fd9-8829-c3d366fd03c1 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:47.804159 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-9fb7389d-a3c4-4fd9-8829-c3d366fd03c1 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:47.805228 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-9fb7389d-a3c4-4fd9-8829-c3d366fd03c1 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:47.805920 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-9fb7389d-a3c4-4fd9-8829-c3d366fd03c1 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:47.849252 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-9fb7389d-a3c4-4fd9-8829-c3d366fd03c1 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:47.850090 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-9fb7389d-a3c4-4fd9-8829-c3d366fd03c1 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:47.850784 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.objects.instance [None req-9fb7389d-a3c4-4fd9-8829-c3d366fd03c1 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lazy-loading 'fault' on Instance uuid 73af9eba-632b-4035-a6ad-02f4fa11866a {{(pid=117971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 22:11:47.901059 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-9fb7389d-a3c4-4fd9-8829-c3d366fd03c1 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:11:47.909218 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-9fb7389d-a3c4-4fd9-8829-c3d366fd03c1 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 200 len: 1311 microversion: 2.1 time: 0.123604 Jun 07 22:11:47.918281 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 558/1109] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:11:47 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 1311 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:11:48.632737 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-9fb75813-dc57-44b7-b760-550115215b96 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:11:48.633357 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-9fb75813-dc57-44b7-b760-550115215b96 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: c00b6e50-3d0c-4614-bf39-f36ae4169292] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:11:48.640191 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-9fb75813-dc57-44b7-b760-550115215b96 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:48.640643 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-9fb75813-dc57-44b7-b760-550115215b96 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:48.641410 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-9fb75813-dc57-44b7-b760-550115215b96 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:48.642101 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-9fb75813-dc57-44b7-b760-550115215b96 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:48.743523 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-9fb75813-dc57-44b7-b760-550115215b96 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:11:48.759425 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-9fb75813-dc57-44b7-b760-550115215b96 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/c00b6e50-3d0c-4614-bf39-f36ae4169292" status: 200 len: 1294 microversion: 2.1 time: 0.130462 Jun 07 22:11:48.761207 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 552/1110] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:11:48 2022] GET /compute/v2.1/servers/c00b6e50-3d0c-4614-bf39-f36ae4169292 => generated 1294 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:11:48.926134 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-f8032af2-095f-427d-bc46-19985545ea8b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:11:48.927249 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-f8032af2-095f-427d-bc46-19985545ea8b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 73af9eba-632b-4035-a6ad-02f4fa11866a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:11:48.941909 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-f8032af2-095f-427d-bc46-19985545ea8b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:48.942752 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-f8032af2-095f-427d-bc46-19985545ea8b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:48.943835 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-f8032af2-095f-427d-bc46-19985545ea8b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:48.944505 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-f8032af2-095f-427d-bc46-19985545ea8b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:48.962599 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.wsgi [None req-f8032af2-095f-427d-bc46-19985545ea8b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] HTTP exception thrown: Instance 73af9eba-632b-4035-a6ad-02f4fa11866a could not be found. Jun 07 22:11:48.970480 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-f8032af2-095f-427d-bc46-19985545ea8b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Request method failure captured: Jun 07 22:11:48.970480 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: request: GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a HTTP/1.1 Jun 07 22:11:48.970480 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Accept: application/json Jun 07 22:11:48.970480 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Accept-Encoding: identity Jun 07 22:11:48.970480 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Connection: close Jun 07 22:11:48.970480 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Content-Length: 0 Jun 07 22:11:48.970480 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Content-Type: application/json Jun 07 22:11:48.970480 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Host: 10.222.0.13 Jun 07 22:11:48.970480 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Openstack-System-Scope: None Jun 07 22:11:48.970480 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: User-Agent: python-urllib3/1.26.9 Jun 07 22:11:48.970480 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Auth-Token: gAAAAABin8sikwri0wz--bbwCQiRTo8aflsbVudHe_idy05qCCCm6kMV6CqJhWmtBn1AnbEoV22lfFfBtXzCrxKFJsUQou-LO31msxwdCukOro2yUZ7Ru7Jq7nfvAeg5tmJuzphYSRHzoedKYtMoC-7_d00L6jKIA57HYnc7FI-lfgXXUmmTM04 Jun 07 22:11:48.970480 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Domain-Id: None Jun 07 22:11:48.970480 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Domain-Name: None Jun 07 22:11:48.970480 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Identity-Status: Confirmed Jun 07 22:11:48.970480 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Is-Admin-Project: True Jun 07 22:11:48.970480 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Domain-Id: default Jun 07 22:11:48.970480 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Domain-Name: Default Jun 07 22:11:48.970480 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Id: 0a4fc48a5efe4d8b974757a5bf7d947e Jun 07 22:11:48.970480 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-676703940 Jun 07 22:11:48.970480 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Role: member,reader Jun 07 22:11:48.970480 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Roles: member,reader Jun 07 22:11:48.972092 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0a4fc48a5efe4d8b974757a5bf7d947e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_0a4fc48a5efe4d8b974757a5bf7d947e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0a4fc48a5efe4d8b974757a5bf7d947e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/0a4fc48a5efe4d8b974757a5bf7d947e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}] Jun 07 22:11:48.972092 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant: tempest-ServerRescueNegativeTestJSON-676703940 Jun 07 22:11:48.972092 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant-Id: 0a4fc48a5efe4d8b974757a5bf7d947e Jun 07 22:11:48.972092 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-676703940 Jun 07 22:11:48.972092 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User: tempest-ServerRescueNegativeTestJSON-676703940-project Jun 07 22:11:48.972092 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Domain-Id: default Jun 07 22:11:48.972092 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Domain-Name: Default Jun 07 22:11:48.972092 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Id: c44c1788959e4b339c9cd5aad4318496 Jun 07 22:11:48.972092 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Name: tempest-ServerRescueNegativeTestJSON-676703940-project Jun 07 22:11:48.972092 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: method: > Jun 07 22:11:48.972092 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: exception: Instance 73af9eba-632b-4035-a6ad-02f4fa11866a could not be found. Jun 07 22:11:48.972092 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: action_args: {'id': '73af9eba-632b-4035-a6ad-02f4fa11866a'} Jun 07 22:11:48.972890 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 22:11:48.972890 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:11:48.972890 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 22:11:48.972890 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 22:11:48.972890 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 22:11:48.972890 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 22:11:48.972890 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 22:11:48.972890 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 22:11:48.972890 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 22:11:48.972890 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 22:11:48.972890 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73af9eba-632b-4035-a6ad-02f4fa11866a could not be found. Jun 07 22:11:48.972890 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:11:48.972890 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:11:48.972890 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:11:48.972890 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:11:48.972890 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:11:48.972890 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:11:48.972890 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 22:11:48.972890 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 22:11:48.972890 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 22:11:48.975068 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 22:11:48.975068 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 22:11:48.975068 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 22:11:48.975068 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 22:11:48.975068 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 22:11:48.975068 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 22:11:48.975068 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 22:11:48.975068 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73af9eba-632b-4035-a6ad-02f4fa11866a could not be found. Jun 07 22:11:48.975068 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:11:48.975068 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:11:48.975068 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:11:48.975068 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:11:48.975068 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:11:48.975068 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:11:48.975068 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 22:11:48.975068 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 22:11:48.975068 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73af9eba-632b-4035-a6ad-02f4fa11866a could not be found. Jun 07 22:11:48.975068 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:11:48.977760 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-f8032af2-095f-427d-bc46-19985545ea8b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Returning 404 to user: Instance 73af9eba-632b-4035-a6ad-02f4fa11866a could not be found. {{(pid=117971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 22:11:48.977760 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-f8032af2-095f-427d-bc46-19985545ea8b tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a" status: 404 len: 111 microversion: 2.1 time: 0.050045 Jun 07 22:11:48.977760 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 559/1111] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:11:48 2022] GET /compute/v2.1/servers/73af9eba-632b-4035-a6ad-02f4fa11866a => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 22:11:48.985345 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-5e28cd82-d86e-4eb6-ac47-f0597e72b238 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:11:48.986116 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-5e28cd82-d86e-4eb6-ac47-f0597e72b238 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 92b3a56b-7d09-4772-b1e4-c75b3971f7a5] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:11:48.994571 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-5e28cd82-d86e-4eb6-ac47-f0597e72b238 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:48.995017 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-5e28cd82-d86e-4eb6-ac47-f0597e72b238 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:48.995833 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-5e28cd82-d86e-4eb6-ac47-f0597e72b238 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:48.996263 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-5e28cd82-d86e-4eb6-ac47-f0597e72b238 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:49.031595 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-5e28cd82-d86e-4eb6-ac47-f0597e72b238 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 92b3a56b-7d09-4772-b1e4-c75b3971f7a5] Going to try to terminate instance {{(pid=117970) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 22:11:49.124823 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-5e28cd82-d86e-4eb6-ac47-f0597e72b238 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "DELETE /compute/v2.1/servers/92b3a56b-7d09-4772-b1e4-c75b3971f7a5" status: 204 len: 0 microversion: 2.1 time: 0.145072 Jun 07 22:11:49.126116 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 553/1112] 10.222.0.13 () {58 vars in 1238 bytes} [Tue Jun 7 22:11:48 2022] DELETE /compute/v2.1/servers/92b3a56b-7d09-4772-b1e4-c75b3971f7a5 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 22:11:49.134380 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-4b61c180-98aa-4d2a-bf19-e9ba139644dd tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:11:49.143924 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-4b61c180-98aa-4d2a-bf19-e9ba139644dd tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 92b3a56b-7d09-4772-b1e4-c75b3971f7a5] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:11:49.156916 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-4b61c180-98aa-4d2a-bf19-e9ba139644dd tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:49.157361 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-4b61c180-98aa-4d2a-bf19-e9ba139644dd tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:49.160942 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-4b61c180-98aa-4d2a-bf19-e9ba139644dd tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:49.162236 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-4b61c180-98aa-4d2a-bf19-e9ba139644dd tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:49.398852 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-4b61c180-98aa-4d2a-bf19-e9ba139644dd tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:11:49.410725 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-4b61c180-98aa-4d2a-bf19-e9ba139644dd tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/92b3a56b-7d09-4772-b1e4-c75b3971f7a5" status: 200 len: 1521 microversion: 2.1 time: 0.280377 Jun 07 22:11:49.431951 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 560/1113] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:11:49 2022] GET /compute/v2.1/servers/92b3a56b-7d09-4772-b1e4-c75b3971f7a5 => generated 1521 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:11:49.779162 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-c8c9cbca-6222-40e3-a09c-6afabac4e3ae tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:11:49.779929 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-c8c9cbca-6222-40e3-a09c-6afabac4e3ae tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: c00b6e50-3d0c-4614-bf39-f36ae4169292] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:11:49.787945 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c8c9cbca-6222-40e3-a09c-6afabac4e3ae tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:49.788395 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c8c9cbca-6222-40e3-a09c-6afabac4e3ae tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:49.789330 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c8c9cbca-6222-40e3-a09c-6afabac4e3ae tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:49.789772 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c8c9cbca-6222-40e3-a09c-6afabac4e3ae tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:50.012284 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [req-c3f0adeb-4149-44d8-8d3f-b9f5c90ad06d req-bd6408ee-cc60-44a3-a96b-d28fc45ba757 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c00b6e50-3d0c-4614-bf39-f36ae4169292", "tag": "866c9fb2-9a6c-4731-b04c-3aa4fcb01a21"}]} {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:11:50.024899 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-c3f0adeb-4149-44d8-8d3f-b9f5c90ad06d req-bd6408ee-cc60-44a3-a96b-d28fc45ba757 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:50.025373 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-c3f0adeb-4149-44d8-8d3f-b9f5c90ad06d req-bd6408ee-cc60-44a3-a96b-d28fc45ba757 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:50.037393 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.compute.server_external_events [req-c3f0adeb-4149-44d8-8d3f-b9f5c90ad06d req-bd6408ee-cc60-44a3-a96b-d28fc45ba757 service nova] Creating event network-changed:866c9fb2-9a6c-4731-b04c-3aa4fcb01a21 for instance c00b6e50-3d0c-4614-bf39-f36ae4169292 on hv-cinder-83552 Jun 07 22:11:50.048778 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [req-c3f0adeb-4149-44d8-8d3f-b9f5c90ad06d req-bd6408ee-cc60-44a3-a96b-d28fc45ba757 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040192 Jun 07 22:11:50.049548 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 561/1114] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:11:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:11:50.307742 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-c8c9cbca-6222-40e3-a09c-6afabac4e3ae tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:11:50.317589 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-c8c9cbca-6222-40e3-a09c-6afabac4e3ae tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/c00b6e50-3d0c-4614-bf39-f36ae4169292" status: 200 len: 1362 microversion: 2.1 time: 0.543145 Jun 07 22:11:50.318295 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 554/1115] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:11:49 2022] GET /compute/v2.1/servers/c00b6e50-3d0c-4614-bf39-f36ae4169292 => generated 1362 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:11:50.434209 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-5dd852eb-a4c3-488f-a527-b4b68e0f68c4 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:11:50.434209 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-5dd852eb-a4c3-488f-a527-b4b68e0f68c4 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 92b3a56b-7d09-4772-b1e4-c75b3971f7a5] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:11:50.440421 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-5dd852eb-a4c3-488f-a527-b4b68e0f68c4 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:50.440952 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-5dd852eb-a4c3-488f-a527-b4b68e0f68c4 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:50.441794 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-5dd852eb-a4c3-488f-a527-b4b68e0f68c4 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:50.442310 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-5dd852eb-a4c3-488f-a527-b4b68e0f68c4 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:50.588329 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-5dd852eb-a4c3-488f-a527-b4b68e0f68c4 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:11:50.606734 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-5dd852eb-a4c3-488f-a527-b4b68e0f68c4 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/92b3a56b-7d09-4772-b1e4-c75b3971f7a5" status: 200 len: 1521 microversion: 2.1 time: 0.178356 Jun 07 22:11:50.610272 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 562/1116] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:11:50 2022] GET /compute/v2.1/servers/92b3a56b-7d09-4772-b1e4-c75b3971f7a5 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:11:51.335092 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-9cff0172-351d-4c22-afce-b0cabc1714a3 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:11:51.335824 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-9cff0172-351d-4c22-afce-b0cabc1714a3 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: c00b6e50-3d0c-4614-bf39-f36ae4169292] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:11:51.342650 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-9cff0172-351d-4c22-afce-b0cabc1714a3 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:51.343808 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-9cff0172-351d-4c22-afce-b0cabc1714a3 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:51.344568 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-9cff0172-351d-4c22-afce-b0cabc1714a3 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:51.345000 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-9cff0172-351d-4c22-afce-b0cabc1714a3 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:51.484281 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-9cff0172-351d-4c22-afce-b0cabc1714a3 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:11:51.491863 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-9cff0172-351d-4c22-afce-b0cabc1714a3 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/c00b6e50-3d0c-4614-bf39-f36ae4169292" status: 200 len: 1362 microversion: 2.1 time: 0.160479 Jun 07 22:11:51.492437 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 555/1117] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:11:51 2022] GET /compute/v2.1/servers/c00b6e50-3d0c-4614-bf39-f36ae4169292 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:11:51.626886 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-f3e44328-bb64-475f-b11c-78287731e52d tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:11:51.627516 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-f3e44328-bb64-475f-b11c-78287731e52d tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 92b3a56b-7d09-4772-b1e4-c75b3971f7a5] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:11:51.634104 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-f3e44328-bb64-475f-b11c-78287731e52d tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:51.634546 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-f3e44328-bb64-475f-b11c-78287731e52d tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:51.635291 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-f3e44328-bb64-475f-b11c-78287731e52d tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:51.635745 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-f3e44328-bb64-475f-b11c-78287731e52d tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:51.702185 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-f3e44328-bb64-475f-b11c-78287731e52d tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:11:51.710617 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-f3e44328-bb64-475f-b11c-78287731e52d tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/92b3a56b-7d09-4772-b1e4-c75b3971f7a5" status: 200 len: 1479 microversion: 2.1 time: 0.088077 Jun 07 22:11:51.711183 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 563/1118] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:11:51 2022] GET /compute/v2.1/servers/92b3a56b-7d09-4772-b1e4-c75b3971f7a5 => generated 1479 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:11:52.085255 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [req-98c07c31-cba5-4630-8e55-865a4a581231 req-1efb5505-7416-4814-b60d-aac5c374eb7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92b3a56b-7d09-4772-b1e4-c75b3971f7a5", "name": "network-vif-deleted", "tag": "94c4dc88-ce6e-456a-a929-9e88a1b3df7d"}]} {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:11:52.093390 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [req-98c07c31-cba5-4630-8e55-865a4a581231 req-1efb5505-7416-4814-b60d-aac5c374eb7d service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:52.093825 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [req-98c07c31-cba5-4630-8e55-865a4a581231 req-1efb5505-7416-4814-b60d-aac5c374eb7d service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:52.104779 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.compute.server_external_events [req-98c07c31-cba5-4630-8e55-865a4a581231 req-1efb5505-7416-4814-b60d-aac5c374eb7d service nova] Creating event network-vif-deleted:94c4dc88-ce6e-456a-a929-9e88a1b3df7d for instance 92b3a56b-7d09-4772-b1e4-c75b3971f7a5 on hv-cinder-83552 Jun 07 22:11:52.110202 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [req-98c07c31-cba5-4630-8e55-865a4a581231 req-1efb5505-7416-4814-b60d-aac5c374eb7d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028643 Jun 07 22:11:52.110776 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 556/1119] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:11:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:11:52.509991 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-82c73dd7-09e0-4133-82fa-a18a7071ade1 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:11:52.510633 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-82c73dd7-09e0-4133-82fa-a18a7071ade1 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: c00b6e50-3d0c-4614-bf39-f36ae4169292] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:11:52.516711 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-82c73dd7-09e0-4133-82fa-a18a7071ade1 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:52.517154 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-82c73dd7-09e0-4133-82fa-a18a7071ade1 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:52.517905 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-82c73dd7-09e0-4133-82fa-a18a7071ade1 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:52.518367 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-82c73dd7-09e0-4133-82fa-a18a7071ade1 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:52.646762 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-82c73dd7-09e0-4133-82fa-a18a7071ade1 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:11:52.654507 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-82c73dd7-09e0-4133-82fa-a18a7071ade1 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/c00b6e50-3d0c-4614-bf39-f36ae4169292" status: 200 len: 1362 microversion: 2.1 time: 0.148364 Jun 07 22:11:52.655066 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 564/1120] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:11:52 2022] GET /compute/v2.1/servers/c00b6e50-3d0c-4614-bf39-f36ae4169292 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:11:52.729033 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-99d9a6ba-c3de-4efb-ab74-458609a4b35c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:11:52.729639 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-99d9a6ba-c3de-4efb-ab74-458609a4b35c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 92b3a56b-7d09-4772-b1e4-c75b3971f7a5] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:11:52.736686 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-99d9a6ba-c3de-4efb-ab74-458609a4b35c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:52.737131 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-99d9a6ba-c3de-4efb-ab74-458609a4b35c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:52.737931 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-99d9a6ba-c3de-4efb-ab74-458609a4b35c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:52.738423 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-99d9a6ba-c3de-4efb-ab74-458609a4b35c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:52.804193 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-99d9a6ba-c3de-4efb-ab74-458609a4b35c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:11:52.812312 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-99d9a6ba-c3de-4efb-ab74-458609a4b35c tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/92b3a56b-7d09-4772-b1e4-c75b3971f7a5" status: 200 len: 1479 microversion: 2.1 time: 0.087638 Jun 07 22:11:52.812978 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 557/1121] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:11:52 2022] GET /compute/v2.1/servers/92b3a56b-7d09-4772-b1e4-c75b3971f7a5 => generated 1479 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:11:53.672765 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-541b2343-164d-4af1-b688-db06dc38610e tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:11:53.673371 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-541b2343-164d-4af1-b688-db06dc38610e tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: c00b6e50-3d0c-4614-bf39-f36ae4169292] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:11:53.681784 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-541b2343-164d-4af1-b688-db06dc38610e tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:53.682248 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-541b2343-164d-4af1-b688-db06dc38610e tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:53.683964 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-541b2343-164d-4af1-b688-db06dc38610e tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:53.684494 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-541b2343-164d-4af1-b688-db06dc38610e tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:53.830504 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-f2bcef81-865c-482f-92c7-2462b06a22a0 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:11:53.832553 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-f2bcef81-865c-482f-92c7-2462b06a22a0 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 92b3a56b-7d09-4772-b1e4-c75b3971f7a5] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:11:53.835263 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-541b2343-164d-4af1-b688-db06dc38610e tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:11:53.841196 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f2bcef81-865c-482f-92c7-2462b06a22a0 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:53.842048 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f2bcef81-865c-482f-92c7-2462b06a22a0 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:53.843977 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f2bcef81-865c-482f-92c7-2462b06a22a0 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:53.844580 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f2bcef81-865c-482f-92c7-2462b06a22a0 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:53.846823 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-541b2343-164d-4af1-b688-db06dc38610e tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/c00b6e50-3d0c-4614-bf39-f36ae4169292" status: 200 len: 1362 microversion: 2.1 time: 0.179012 Jun 07 22:11:53.857020 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 565/1122] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:11:53 2022] GET /compute/v2.1/servers/c00b6e50-3d0c-4614-bf39-f36ae4169292 => generated 1362 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:11:53.889113 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f2bcef81-865c-482f-92c7-2462b06a22a0 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:53.889634 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f2bcef81-865c-482f-92c7-2462b06a22a0 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:53.890162 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.objects.instance [None req-f2bcef81-865c-482f-92c7-2462b06a22a0 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lazy-loading 'fault' on Instance uuid 92b3a56b-7d09-4772-b1e4-c75b3971f7a5 {{(pid=117970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 22:11:53.953780 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-f2bcef81-865c-482f-92c7-2462b06a22a0 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44c1788959e4b339c9cd5aad4318496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4fc48a5efe4d8b974757a5bf7d947e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:11:53.961339 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-f2bcef81-865c-482f-92c7-2462b06a22a0 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/92b3a56b-7d09-4772-b1e4-c75b3971f7a5" status: 200 len: 1312 microversion: 2.1 time: 0.135909 Jun 07 22:11:53.961871 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 558/1123] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:11:53 2022] GET /compute/v2.1/servers/92b3a56b-7d09-4772-b1e4-c75b3971f7a5 => generated 1312 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:11:54.864821 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-3b4aa0b0-9f20-43b6-a6b9-09d099a90f7c tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:11:54.865428 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-3b4aa0b0-9f20-43b6-a6b9-09d099a90f7c tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: c00b6e50-3d0c-4614-bf39-f36ae4169292] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:11:54.872232 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-3b4aa0b0-9f20-43b6-a6b9-09d099a90f7c tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:54.872682 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-3b4aa0b0-9f20-43b6-a6b9-09d099a90f7c tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:54.873452 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-3b4aa0b0-9f20-43b6-a6b9-09d099a90f7c tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:54.873939 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-3b4aa0b0-9f20-43b6-a6b9-09d099a90f7c tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:54.978126 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-2cfae020-338f-4340-9648-69e5baef7e64 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:11:54.979655 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-2cfae020-338f-4340-9648-69e5baef7e64 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] [instance: 92b3a56b-7d09-4772-b1e4-c75b3971f7a5] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:11:54.987252 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-2cfae020-338f-4340-9648-69e5baef7e64 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:54.987917 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-2cfae020-338f-4340-9648-69e5baef7e64 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:54.988933 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-2cfae020-338f-4340-9648-69e5baef7e64 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:54.989431 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-2cfae020-338f-4340-9648-69e5baef7e64 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:55.006533 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.wsgi [None req-2cfae020-338f-4340-9648-69e5baef7e64 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] HTTP exception thrown: Instance 92b3a56b-7d09-4772-b1e4-c75b3971f7a5 could not be found. Jun 07 22:11:55.008531 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-2cfae020-338f-4340-9648-69e5baef7e64 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Request method failure captured: Jun 07 22:11:55.008531 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: request: GET /compute/v2.1/servers/92b3a56b-7d09-4772-b1e4-c75b3971f7a5 HTTP/1.1 Jun 07 22:11:55.008531 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Accept: application/json Jun 07 22:11:55.008531 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Accept-Encoding: identity Jun 07 22:11:55.008531 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Connection: close Jun 07 22:11:55.008531 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Content-Length: 0 Jun 07 22:11:55.008531 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Content-Type: application/json Jun 07 22:11:55.008531 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Host: 10.222.0.13 Jun 07 22:11:55.008531 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Openstack-System-Scope: None Jun 07 22:11:55.008531 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: User-Agent: python-urllib3/1.26.9 Jun 07 22:11:55.008531 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Auth-Token: gAAAAABin8sikwri0wz--bbwCQiRTo8aflsbVudHe_idy05qCCCm6kMV6CqJhWmtBn1AnbEoV22lfFfBtXzCrxKFJsUQou-LO31msxwdCukOro2yUZ7Ru7Jq7nfvAeg5tmJuzphYSRHzoedKYtMoC-7_d00L6jKIA57HYnc7FI-lfgXXUmmTM04 Jun 07 22:11:55.008531 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Domain-Id: None Jun 07 22:11:55.008531 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Domain-Name: None Jun 07 22:11:55.008531 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Identity-Status: Confirmed Jun 07 22:11:55.008531 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Is-Admin-Project: True Jun 07 22:11:55.008531 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Domain-Id: default Jun 07 22:11:55.008531 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Domain-Name: Default Jun 07 22:11:55.008531 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Id: 0a4fc48a5efe4d8b974757a5bf7d947e Jun 07 22:11:55.008531 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-676703940 Jun 07 22:11:55.008531 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Role: member,reader Jun 07 22:11:55.008531 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Roles: member,reader Jun 07 22:11:55.009989 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0a4fc48a5efe4d8b974757a5bf7d947e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_0a4fc48a5efe4d8b974757a5bf7d947e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0a4fc48a5efe4d8b974757a5bf7d947e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/0a4fc48a5efe4d8b974757a5bf7d947e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}] Jun 07 22:11:55.009989 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Tenant: tempest-ServerRescueNegativeTestJSON-676703940 Jun 07 22:11:55.009989 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Tenant-Id: 0a4fc48a5efe4d8b974757a5bf7d947e Jun 07 22:11:55.009989 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-676703940 Jun 07 22:11:55.009989 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User: tempest-ServerRescueNegativeTestJSON-676703940-project Jun 07 22:11:55.009989 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Domain-Id: default Jun 07 22:11:55.009989 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Domain-Name: Default Jun 07 22:11:55.009989 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Id: c44c1788959e4b339c9cd5aad4318496 Jun 07 22:11:55.009989 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Name: tempest-ServerRescueNegativeTestJSON-676703940-project Jun 07 22:11:55.009989 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: method: > Jun 07 22:11:55.009989 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: exception: Instance 92b3a56b-7d09-4772-b1e4-c75b3971f7a5 could not be found. Jun 07 22:11:55.009989 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: action_args: {'id': '92b3a56b-7d09-4772-b1e4-c75b3971f7a5'} Jun 07 22:11:55.010924 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 22:11:55.010924 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:11:55.010924 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 22:11:55.010924 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 22:11:55.010924 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 22:11:55.010924 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 22:11:55.010924 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 22:11:55.010924 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 22:11:55.010924 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 22:11:55.010924 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 22:11:55.010924 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92b3a56b-7d09-4772-b1e4-c75b3971f7a5 could not be found. Jun 07 22:11:55.010924 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:11:55.010924 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:11:55.010924 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:11:55.010924 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:11:55.010924 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:11:55.010924 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:11:55.010924 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 22:11:55.010924 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 22:11:55.010924 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 22:11:55.012425 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 22:11:55.012425 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 22:11:55.012425 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 22:11:55.012425 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 22:11:55.012425 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 22:11:55.012425 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 22:11:55.012425 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 22:11:55.012425 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92b3a56b-7d09-4772-b1e4-c75b3971f7a5 could not be found. Jun 07 22:11:55.012425 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:11:55.012425 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:11:55.012425 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:11:55.012425 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:11:55.012425 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:11:55.012425 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:11:55.012425 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 22:11:55.012425 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 22:11:55.012425 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92b3a56b-7d09-4772-b1e4-c75b3971f7a5 could not be found. Jun 07 22:11:55.012425 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:11:55.013836 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-2cfae020-338f-4340-9648-69e5baef7e64 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] Returning 404 to user: Instance 92b3a56b-7d09-4772-b1e4-c75b3971f7a5 could not be found. {{(pid=117970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 22:11:55.013836 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-2cfae020-338f-4340-9648-69e5baef7e64 tempest-ServerRescueNegativeTestJSON-676703940 tempest-ServerRescueNegativeTestJSON-676703940-project] 10.222.0.13 "GET /compute/v2.1/servers/92b3a56b-7d09-4772-b1e4-c75b3971f7a5" status: 404 len: 111 microversion: 2.1 time: 0.036709 Jun 07 22:11:55.013836 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 559/1124] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:11:54 2022] GET /compute/v2.1/servers/92b3a56b-7d09-4772-b1e4-c75b3971f7a5 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 07 22:11:55.014116 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-3b4aa0b0-9f20-43b6-a6b9-09d099a90f7c tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:11:55.023514 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-3b4aa0b0-9f20-43b6-a6b9-09d099a90f7c tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/c00b6e50-3d0c-4614-bf39-f36ae4169292" status: 200 len: 1362 microversion: 2.1 time: 0.162424 Jun 07 22:11:55.024321 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 566/1125] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:11:54 2022] GET /compute/v2.1/servers/c00b6e50-3d0c-4614-bf39-f36ae4169292 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:11:56.042773 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-00cff590-c116-4228-92e6-a919290735a5 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:11:56.043502 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-00cff590-c116-4228-92e6-a919290735a5 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: c00b6e50-3d0c-4614-bf39-f36ae4169292] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:11:56.050580 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-00cff590-c116-4228-92e6-a919290735a5 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:56.051024 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-00cff590-c116-4228-92e6-a919290735a5 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:56.051801 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-00cff590-c116-4228-92e6-a919290735a5 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:56.052543 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-00cff590-c116-4228-92e6-a919290735a5 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:56.192230 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-00cff590-c116-4228-92e6-a919290735a5 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:11:56.200133 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-00cff590-c116-4228-92e6-a919290735a5 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/c00b6e50-3d0c-4614-bf39-f36ae4169292" status: 200 len: 1362 microversion: 2.1 time: 0.161956 Jun 07 22:11:56.200934 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 560/1126] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:11:56 2022] GET /compute/v2.1/servers/c00b6e50-3d0c-4614-bf39-f36ae4169292 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:11:57.219909 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-c86d2547-c4f8-4a53-b632-eaa8b7e8dad5 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:11:57.221251 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-c86d2547-c4f8-4a53-b632-eaa8b7e8dad5 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: c00b6e50-3d0c-4614-bf39-f36ae4169292] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:11:57.228678 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_cell0:SELECT=6 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:11:57.231653 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c86d2547-c4f8-4a53-b632-eaa8b7e8dad5 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:57.232366 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c86d2547-c4f8-4a53-b632-eaa8b7e8dad5 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:57.233411 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c86d2547-c4f8-4a53-b632-eaa8b7e8dad5 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:57.234489 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c86d2547-c4f8-4a53-b632-eaa8b7e8dad5 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:57.381067 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-c86d2547-c4f8-4a53-b632-eaa8b7e8dad5 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:11:57.388885 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-c86d2547-c4f8-4a53-b632-eaa8b7e8dad5 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/c00b6e50-3d0c-4614-bf39-f36ae4169292" status: 200 len: 1362 microversion: 2.1 time: 0.174551 Jun 07 22:11:57.389969 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 567/1127] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:11:57 2022] GET /compute/v2.1/servers/c00b6e50-3d0c-4614-bf39-f36ae4169292 => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:11:57.612839 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [req-0bbb012c-af23-469b-ac44-ae5036c980e6 req-74e4ed7d-6733-4ff0-a56b-e168d01d7e00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c00b6e50-3d0c-4614-bf39-f36ae4169292", "name": "network-vif-plugged", "status": "completed", "tag": "866c9fb2-9a6c-4731-b04c-3aa4fcb01a21"}]} {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:11:57.618421 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_cell0:SELECT=2 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:11:57.619196 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_cell0:SELECT=10 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:11:57.625039 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [req-0bbb012c-af23-469b-ac44-ae5036c980e6 req-74e4ed7d-6733-4ff0-a56b-e168d01d7e00 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:57.626098 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [req-0bbb012c-af23-469b-ac44-ae5036c980e6 req-74e4ed7d-6733-4ff0-a56b-e168d01d7e00 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:57.645089 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.compute.server_external_events [req-0bbb012c-af23-469b-ac44-ae5036c980e6 req-74e4ed7d-6733-4ff0-a56b-e168d01d7e00 service nova] Creating event network-vif-plugged:866c9fb2-9a6c-4731-b04c-3aa4fcb01a21 for instance c00b6e50-3d0c-4614-bf39-f36ae4169292 on hv-cinder-83552 Jun 07 22:11:57.650635 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [req-0bbb012c-af23-469b-ac44-ae5036c980e6 req-74e4ed7d-6733-4ff0-a56b-e168d01d7e00 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042554 Jun 07 22:11:57.651593 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 561/1128] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:11:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:11:58.406500 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-453c748b-1026-4d35-8162-c431852fed0d tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:11:58.407723 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-453c748b-1026-4d35-8162-c431852fed0d tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: c00b6e50-3d0c-4614-bf39-f36ae4169292] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:11:58.410487 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:11:58.417422 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-453c748b-1026-4d35-8162-c431852fed0d tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:58.418642 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-453c748b-1026-4d35-8162-c431852fed0d tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:58.419950 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-453c748b-1026-4d35-8162-c431852fed0d tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:58.422297 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-453c748b-1026-4d35-8162-c431852fed0d tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:58.602351 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-453c748b-1026-4d35-8162-c431852fed0d tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:11:58.610275 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-453c748b-1026-4d35-8162-c431852fed0d tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/c00b6e50-3d0c-4614-bf39-f36ae4169292" status: 200 len: 1362 microversion: 2.1 time: 0.208066 Jun 07 22:11:58.610849 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 568/1129] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:11:58 2022] GET /compute/v2.1/servers/c00b6e50-3d0c-4614-bf39-f36ae4169292 => generated 1362 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:11:59.628605 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-bd29a8b0-1051-41f8-94b4-d8f4061ba4c2 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:11:59.629294 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-bd29a8b0-1051-41f8-94b4-d8f4061ba4c2 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: c00b6e50-3d0c-4614-bf39-f36ae4169292] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:11:59.635630 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-bd29a8b0-1051-41f8-94b4-d8f4061ba4c2 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:59.636075 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-bd29a8b0-1051-41f8-94b4-d8f4061ba4c2 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:59.636922 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-bd29a8b0-1051-41f8-94b4-d8f4061ba4c2 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:11:59.637473 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-bd29a8b0-1051-41f8-94b4-d8f4061ba4c2 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:11:59.779459 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-bd29a8b0-1051-41f8-94b4-d8f4061ba4c2 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:11:59.787212 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-bd29a8b0-1051-41f8-94b4-d8f4061ba4c2 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/c00b6e50-3d0c-4614-bf39-f36ae4169292" status: 200 len: 1362 microversion: 2.1 time: 0.163138 Jun 07 22:11:59.787780 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 562/1130] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:11:59 2022] GET /compute/v2.1/servers/c00b6e50-3d0c-4614-bf39-f36ae4169292 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:12:00.804523 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-b7d4c926-478d-4b72-8a76-aa55af4b7f58 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:12:00.805134 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-b7d4c926-478d-4b72-8a76-aa55af4b7f58 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: c00b6e50-3d0c-4614-bf39-f36ae4169292] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:12:00.813254 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b7d4c926-478d-4b72-8a76-aa55af4b7f58 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:00.813793 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b7d4c926-478d-4b72-8a76-aa55af4b7f58 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:00.814571 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b7d4c926-478d-4b72-8a76-aa55af4b7f58 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:00.815006 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b7d4c926-478d-4b72-8a76-aa55af4b7f58 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:00.984401 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-b7d4c926-478d-4b72-8a76-aa55af4b7f58 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:12:00.991804 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-b7d4c926-478d-4b72-8a76-aa55af4b7f58 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/c00b6e50-3d0c-4614-bf39-f36ae4169292" status: 200 len: 1547 microversion: 2.1 time: 0.191151 Jun 07 22:12:00.992371 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 569/1131] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:12:00 2022] GET /compute/v2.1/servers/c00b6e50-3d0c-4614-bf39-f36ae4169292 => generated 1547 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:12:01.008635 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-d1c262a2-bba8-4e63-a679-58c88a99e635 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:12:01.009200 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-d1c262a2-bba8-4e63-a679-58c88a99e635 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: c00b6e50-3d0c-4614-bf39-f36ae4169292] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:12:01.015671 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d1c262a2-bba8-4e63-a679-58c88a99e635 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:01.016116 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d1c262a2-bba8-4e63-a679-58c88a99e635 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:01.016860 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d1c262a2-bba8-4e63-a679-58c88a99e635 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:01.017284 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d1c262a2-bba8-4e63-a679-58c88a99e635 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:01.112942 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-d1c262a2-bba8-4e63-a679-58c88a99e635 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/c00b6e50-3d0c-4614-bf39-f36ae4169292/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.108064 Jun 07 22:12:01.113542 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 563/1132] 10.222.0.13 () {58 vars in 1274 bytes} [Tue Jun 7 22:12:01 2022] GET /compute/v2.1/servers/c00b6e50-3d0c-4614-bf39-f36ae4169292/os-interface => generated 284 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:12:02.398825 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [req-9c7c926b-4a4c-4489-af31-2ce856c2e1c6 req-52ef2db1-9344-485c-9679-476284e17e0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c00b6e50-3d0c-4614-bf39-f36ae4169292", "tag": "866c9fb2-9a6c-4731-b04c-3aa4fcb01a21"}]} {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:12:02.408205 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-9c7c926b-4a4c-4489-af31-2ce856c2e1c6 req-52ef2db1-9344-485c-9679-476284e17e0f service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:02.408644 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-9c7c926b-4a4c-4489-af31-2ce856c2e1c6 req-52ef2db1-9344-485c-9679-476284e17e0f service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:02.424205 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.compute.server_external_events [req-9c7c926b-4a4c-4489-af31-2ce856c2e1c6 req-52ef2db1-9344-485c-9679-476284e17e0f service nova] Creating event network-changed:866c9fb2-9a6c-4731-b04c-3aa4fcb01a21 for instance c00b6e50-3d0c-4614-bf39-f36ae4169292 on hv-cinder-83552 Jun 07 22:12:02.429966 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [req-9c7c926b-4a4c-4489-af31-2ce856c2e1c6 req-52ef2db1-9344-485c-9679-476284e17e0f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034527 Jun 07 22:12:02.430562 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 570/1133] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:12:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 22:12:08.265802 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-59a173bb-bb58-43d6-80e0-1e3ce88ee215 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1022675656", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-813171803", "security_groups": [{"name": "tempest-secgroup-smoke-1476284195"}], "networks": [{"uuid": "d7fbfd3d-98e3-4a5a-a839-8c42dabd5fac"}], "block_device_mapping_v2": [{"uuid": "442aeade-cfe7-43cd-bf31-72553e6bfbe0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:12:08.273746 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:12:08.379270 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.network.neutron [None req-59a173bb-bb58-43d6-80e0-1e3ce88ee215 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] validate_networks() for [('d7fbfd3d-98e3-4a5a-a839-8c42dabd5fac', None, None, None, None, None)] {{(pid=117970) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 22:12:09.013786 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.virt.hardware [None req-59a173bb-bb58-43d6-80e0-1e3ce88ee215 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Flavor limits 0:0:0 {{(pid=117970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 22:12:09.014957 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.virt.hardware [None req-59a173bb-bb58-43d6-80e0-1e3ce88ee215 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Image limits 0:0:0 {{(pid=117970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 22:12:09.015468 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.virt.hardware [None req-59a173bb-bb58-43d6-80e0-1e3ce88ee215 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Flavor pref 0:0:0 {{(pid=117970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 22:12:09.015871 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.virt.hardware [None req-59a173bb-bb58-43d6-80e0-1e3ce88ee215 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Image pref 0:0:0 {{(pid=117970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 22:12:09.016275 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.virt.hardware [None req-59a173bb-bb58-43d6-80e0-1e3ce88ee215 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 22:12:09.024929 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-59a173bb-bb58-43d6-80e0-1e3ce88ee215 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:09.025366 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-59a173bb-bb58-43d6-80e0-1e3ce88ee215 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:09.026138 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-59a173bb-bb58-43d6-80e0-1e3ce88ee215 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:09.026563 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-59a173bb-bb58-43d6-80e0-1e3ce88ee215 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:09.044503 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.quota [None req-59a173bb-bb58-43d6-80e0-1e3ce88ee215 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Getting quotas for project 98914183afee4e58ad7a425cb019e639. Resources: {'cores', 'ram', 'instances'} {{(pid=117970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 22:12:09.050867 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.quota [None req-59a173bb-bb58-43d6-80e0-1e3ce88ee215 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Getting quotas for user 7e8c46b1820a4ce5ac853ab1cc88fc30 and project 98914183afee4e58ad7a425cb019e639. Resources: {'cores', 'ram', 'instances'} {{(pid=117970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 22:12:09.110180 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-59a173bb-bb58-43d6-80e0-1e3ce88ee215 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Going to run 1 instances... {{(pid=117970) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 22:12:09.112294 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-59a173bb-bb58-43d6-80e0-1e3ce88ee215 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] [instance: 4d8ab38f-db6d-4560-962e-c1e55c509ce1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='442aeade-cfe7-43cd-bf31-72553e6bfbe0',volume_size=None,volume_type=None)] {{(pid=117970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 22:12:09.234489 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-59a173bb-bb58-43d6-80e0-1e3ce88ee215 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.973707 Jun 07 22:12:09.235130 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 564/1134] 10.222.0.13 () {60 vars in 1146 bytes} [Tue Jun 7 22:12:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 975 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 22:12:09.245345 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-fffe114a-e5c5-48de-b15d-aab708fb76e1 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:12:09.246039 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-fffe114a-e5c5-48de-b15d-aab708fb76e1 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] [instance: 4d8ab38f-db6d-4560-962e-c1e55c509ce1] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:12:09.304296 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-fffe114a-e5c5-48de-b15d-aab708fb76e1 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e8c46b1820a4ce5ac853ab1cc88fc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98914183afee4e58ad7a425cb019e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:12:09.311104 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-fffe114a-e5c5-48de-b15d-aab708fb76e1 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] 10.222.0.13 "GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1" status: 200 len: 1088 microversion: 2.1 time: 0.069814 Jun 07 22:12:09.311975 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 571/1135] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:12:09 2022] GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1 => generated 1088 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:12:10.330013 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-8fd86407-54f7-4027-a96c-eb8488ef5165 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:12:10.330619 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-8fd86407-54f7-4027-a96c-eb8488ef5165 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] [instance: 4d8ab38f-db6d-4560-962e-c1e55c509ce1] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:12:10.336762 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-8fd86407-54f7-4027-a96c-eb8488ef5165 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:10.337208 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-8fd86407-54f7-4027-a96c-eb8488ef5165 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:10.337955 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-8fd86407-54f7-4027-a96c-eb8488ef5165 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:10.338406 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-8fd86407-54f7-4027-a96c-eb8488ef5165 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:10.398660 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-8fd86407-54f7-4027-a96c-eb8488ef5165 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e8c46b1820a4ce5ac853ab1cc88fc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98914183afee4e58ad7a425cb019e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:12:10.406024 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-8fd86407-54f7-4027-a96c-eb8488ef5165 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] 10.222.0.13 "GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1" status: 200 len: 1138 microversion: 2.1 time: 0.082292 Jun 07 22:12:10.406582 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 565/1136] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:12:10 2022] GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1 => generated 1138 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:12:10.714349 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-47a0c197-d4f6-4f9f-96d4-2e8512327a33 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:12:10.714926 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-47a0c197-d4f6-4f9f-96d4-2e8512327a33 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: b8a810a4-60df-4062-baae-8f11e0615a49] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:12:10.721569 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-47a0c197-d4f6-4f9f-96d4-2e8512327a33 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:10.722016 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-47a0c197-d4f6-4f9f-96d4-2e8512327a33 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:10.722800 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-47a0c197-d4f6-4f9f-96d4-2e8512327a33 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:10.723244 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-47a0c197-d4f6-4f9f-96d4-2e8512327a33 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:10.725680 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_cell1:SELECT=90 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:12:10.747765 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-47a0c197-d4f6-4f9f-96d4-2e8512327a33 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/b8a810a4-60df-4062-baae-8f11e0615a49/ips" status: 200 len: 150 microversion: 2.1 time: 0.037320 Jun 07 22:12:10.748333 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 572/1137] 10.222.0.13 () {58 vars in 1247 bytes} [Tue Jun 7 22:12:10 2022] GET /compute/v2.1/servers/b8a810a4-60df-4062-baae-8f11e0615a49/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:12:11.423216 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-998a34e5-c4a8-46ae-9f87-5252858f2dd7 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:12:11.423869 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-998a34e5-c4a8-46ae-9f87-5252858f2dd7 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] [instance: 4d8ab38f-db6d-4560-962e-c1e55c509ce1] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:12:11.430512 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-998a34e5-c4a8-46ae-9f87-5252858f2dd7 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:11.431014 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-998a34e5-c4a8-46ae-9f87-5252858f2dd7 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:11.431805 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-998a34e5-c4a8-46ae-9f87-5252858f2dd7 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:11.432263 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-998a34e5-c4a8-46ae-9f87-5252858f2dd7 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:11.449868 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:12:11.498021 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-998a34e5-c4a8-46ae-9f87-5252858f2dd7 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e8c46b1820a4ce5ac853ab1cc88fc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98914183afee4e58ad7a425cb019e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:12:11.505655 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-998a34e5-c4a8-46ae-9f87-5252858f2dd7 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] 10.222.0.13 "GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1" status: 200 len: 1138 microversion: 2.1 time: 0.087061 Jun 07 22:12:11.506232 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 566/1138] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:12:11 2022] GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1 => generated 1138 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:12:12.522898 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-fe04b413-8514-4384-8b88-0371049c15db tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:12:12.523539 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-fe04b413-8514-4384-8b88-0371049c15db tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] [instance: 4d8ab38f-db6d-4560-962e-c1e55c509ce1] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:12:12.530618 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-fe04b413-8514-4384-8b88-0371049c15db tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:12.531060 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-fe04b413-8514-4384-8b88-0371049c15db tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:12.531907 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-fe04b413-8514-4384-8b88-0371049c15db tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:12.532341 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-fe04b413-8514-4384-8b88-0371049c15db tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:12.594881 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-fe04b413-8514-4384-8b88-0371049c15db tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e8c46b1820a4ce5ac853ab1cc88fc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98914183afee4e58ad7a425cb019e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:12:12.602614 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-fe04b413-8514-4384-8b88-0371049c15db tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] 10.222.0.13 "GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1" status: 200 len: 1130 microversion: 2.1 time: 0.083341 Jun 07 22:12:12.603167 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 573/1139] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:12:12 2022] GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1 => generated 1130 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:12:13.620328 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-bdf0ae28-8447-452e-90b9-0d2a751087a2 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:12:13.621162 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-bdf0ae28-8447-452e-90b9-0d2a751087a2 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] [instance: 4d8ab38f-db6d-4560-962e-c1e55c509ce1] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:12:13.628124 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-bdf0ae28-8447-452e-90b9-0d2a751087a2 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:13.628572 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-bdf0ae28-8447-452e-90b9-0d2a751087a2 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:13.629324 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-bdf0ae28-8447-452e-90b9-0d2a751087a2 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:13.629752 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-bdf0ae28-8447-452e-90b9-0d2a751087a2 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:13.704318 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-bdf0ae28-8447-452e-90b9-0d2a751087a2 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e8c46b1820a4ce5ac853ab1cc88fc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98914183afee4e58ad7a425cb019e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:12:13.711620 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-bdf0ae28-8447-452e-90b9-0d2a751087a2 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] 10.222.0.13 "GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1" status: 200 len: 1204 microversion: 2.1 time: 0.095228 Jun 07 22:12:13.712186 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 567/1140] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:12:13 2022] GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1 => generated 1204 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:12:14.193082 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-373931fa-819f-4833-9f04-89f0dbf129c5 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f37bd690-ca7f-49b8-ba42-8b0e11592898"}} {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:12:14.194211 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-373931fa-819f-4833-9f04-89f0dbf129c5 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: b8a810a4-60df-4062-baae-8f11e0615a49] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:12:14.202920 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-373931fa-819f-4833-9f04-89f0dbf129c5 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:14.203416 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-373931fa-819f-4833-9f04-89f0dbf129c5 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:14.204194 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-373931fa-819f-4833-9f04-89f0dbf129c5 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:14.204636 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-373931fa-819f-4833-9f04-89f0dbf129c5 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:14.525913 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-373931fa-819f-4833-9f04-89f0dbf129c5 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "POST /compute/v2.1/servers/b8a810a4-60df-4062-baae-8f11e0615a49/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.336501 Jun 07 22:12:14.527029 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 574/1141] 10.222.0.13 () {60 vars in 1322 bytes} [Tue Jun 7 22:12:14 2022] POST /compute/v2.1/servers/b8a810a4-60df-4062-baae-8f11e0615a49/os-volume_attachments => generated 194 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:12:14.730727 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-61bf7d7d-9374-4570-954f-ece18fd7bb44 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:12:14.732256 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-61bf7d7d-9374-4570-954f-ece18fd7bb44 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] [instance: 4d8ab38f-db6d-4560-962e-c1e55c509ce1] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:12:14.740408 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-61bf7d7d-9374-4570-954f-ece18fd7bb44 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:14.740882 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-61bf7d7d-9374-4570-954f-ece18fd7bb44 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:14.741943 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-61bf7d7d-9374-4570-954f-ece18fd7bb44 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:14.742365 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-61bf7d7d-9374-4570-954f-ece18fd7bb44 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:14.969439 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [req-90740563-29dc-47ea-8693-dd39eca32f66 req-c9e1cc18-5f04-44d5-b5ca-d10d8e7e7a2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d8ab38f-db6d-4560-962e-c1e55c509ce1", "tag": "c6cae0af-2220-44aa-8bba-70f301632681"}]} {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:12:14.978288 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-61bf7d7d-9374-4570-954f-ece18fd7bb44 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e8c46b1820a4ce5ac853ab1cc88fc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98914183afee4e58ad7a425cb019e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:12:14.985168 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-90740563-29dc-47ea-8693-dd39eca32f66 req-c9e1cc18-5f04-44d5-b5ca-d10d8e7e7a2e service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:14.985611 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-90740563-29dc-47ea-8693-dd39eca32f66 req-c9e1cc18-5f04-44d5-b5ca-d10d8e7e7a2e service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:14.996766 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-61bf7d7d-9374-4570-954f-ece18fd7bb44 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] 10.222.0.13 "GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1" status: 200 len: 1260 microversion: 2.1 time: 0.271887 Jun 07 22:12:14.997538 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 568/1142] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:12:14 2022] GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1 => generated 1260 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:12:15.014004 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.compute.server_external_events [req-90740563-29dc-47ea-8693-dd39eca32f66 req-c9e1cc18-5f04-44d5-b5ca-d10d8e7e7a2e service nova] Creating event network-changed:c6cae0af-2220-44aa-8bba-70f301632681 for instance 4d8ab38f-db6d-4560-962e-c1e55c509ce1 on hv-cinder-83552 Jun 07 22:12:15.018978 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [req-90740563-29dc-47ea-8693-dd39eca32f66 req-c9e1cc18-5f04-44d5-b5ca-d10d8e7e7a2e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057838 Jun 07 22:12:15.019785 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 575/1143] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:12:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:12:16.014636 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-028bf833-363a-466e-a6cd-f8cc91c6d82d tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:12:16.015459 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-028bf833-363a-466e-a6cd-f8cc91c6d82d tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] [instance: 4d8ab38f-db6d-4560-962e-c1e55c509ce1] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:12:16.021963 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-028bf833-363a-466e-a6cd-f8cc91c6d82d tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:16.022595 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-028bf833-363a-466e-a6cd-f8cc91c6d82d tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:16.023437 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-028bf833-363a-466e-a6cd-f8cc91c6d82d tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:16.023871 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-028bf833-363a-466e-a6cd-f8cc91c6d82d tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:16.164591 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-028bf833-363a-466e-a6cd-f8cc91c6d82d tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e8c46b1820a4ce5ac853ab1cc88fc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98914183afee4e58ad7a425cb019e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:12:16.172367 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-028bf833-363a-466e-a6cd-f8cc91c6d82d tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] 10.222.0.13 "GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1" status: 200 len: 1260 microversion: 2.1 time: 0.162268 Jun 07 22:12:16.172922 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 569/1144] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:12:16 2022] GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1 => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:12:17.190695 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-ea4249d3-e2f3-4ecd-ab8c-2f2c954be8d0 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:12:17.191410 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-ea4249d3-e2f3-4ecd-ab8c-2f2c954be8d0 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] [instance: 4d8ab38f-db6d-4560-962e-c1e55c509ce1] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:12:17.197496 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ea4249d3-e2f3-4ecd-ab8c-2f2c954be8d0 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:17.197938 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ea4249d3-e2f3-4ecd-ab8c-2f2c954be8d0 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:17.198688 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ea4249d3-e2f3-4ecd-ab8c-2f2c954be8d0 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:17.199113 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ea4249d3-e2f3-4ecd-ab8c-2f2c954be8d0 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:17.339001 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-ea4249d3-e2f3-4ecd-ab8c-2f2c954be8d0 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e8c46b1820a4ce5ac853ab1cc88fc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98914183afee4e58ad7a425cb019e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:12:17.346615 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-ea4249d3-e2f3-4ecd-ab8c-2f2c954be8d0 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] 10.222.0.13 "GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1" status: 200 len: 1260 microversion: 2.1 time: 0.161034 Jun 07 22:12:17.347192 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 576/1145] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:12:17 2022] GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:12:18.363305 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-16e46577-2373-4f83-afe5-c27f1cca4c66 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:12:18.363941 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-16e46577-2373-4f83-afe5-c27f1cca4c66 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] [instance: 4d8ab38f-db6d-4560-962e-c1e55c509ce1] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:12:18.370396 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-16e46577-2373-4f83-afe5-c27f1cca4c66 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:18.371049 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-16e46577-2373-4f83-afe5-c27f1cca4c66 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:18.372045 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-16e46577-2373-4f83-afe5-c27f1cca4c66 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:18.372464 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-16e46577-2373-4f83-afe5-c27f1cca4c66 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:18.522861 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-16e46577-2373-4f83-afe5-c27f1cca4c66 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e8c46b1820a4ce5ac853ab1cc88fc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98914183afee4e58ad7a425cb019e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:12:18.533464 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-16e46577-2373-4f83-afe5-c27f1cca4c66 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] 10.222.0.13 "GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1" status: 200 len: 1260 microversion: 2.1 time: 0.173960 Jun 07 22:12:18.534331 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 570/1146] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:12:18 2022] GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1 => generated 1260 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:12:19.552781 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-0fb91c9e-90c6-4a7e-a5a2-1ced52cb9ae0 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:12:19.553412 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-0fb91c9e-90c6-4a7e-a5a2-1ced52cb9ae0 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] [instance: 4d8ab38f-db6d-4560-962e-c1e55c509ce1] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:12:19.555848 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_cell0:SELECT=2 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:12:19.561353 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-0fb91c9e-90c6-4a7e-a5a2-1ced52cb9ae0 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:19.561828 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-0fb91c9e-90c6-4a7e-a5a2-1ced52cb9ae0 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:19.563121 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-0fb91c9e-90c6-4a7e-a5a2-1ced52cb9ae0 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:19.563734 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-0fb91c9e-90c6-4a7e-a5a2-1ced52cb9ae0 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:19.699777 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-0fb91c9e-90c6-4a7e-a5a2-1ced52cb9ae0 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e8c46b1820a4ce5ac853ab1cc88fc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98914183afee4e58ad7a425cb019e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:12:19.707649 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-0fb91c9e-90c6-4a7e-a5a2-1ced52cb9ae0 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] 10.222.0.13 "GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1" status: 200 len: 1260 microversion: 2.1 time: 0.158432 Jun 07 22:12:19.708042 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 577/1147] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:12:19 2022] GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:12:20.724010 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-e1d4b976-ba14-4e8c-9082-fa77713df0f4 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:12:20.724725 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-e1d4b976-ba14-4e8c-9082-fa77713df0f4 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] [instance: 4d8ab38f-db6d-4560-962e-c1e55c509ce1] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:12:20.726757 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_cell0:SELECT=2 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:12:20.727717 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_cell0:SELECT=6 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:12:20.734778 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e1d4b976-ba14-4e8c-9082-fa77713df0f4 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:20.735225 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e1d4b976-ba14-4e8c-9082-fa77713df0f4 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:20.736022 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e1d4b976-ba14-4e8c-9082-fa77713df0f4 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:20.736487 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e1d4b976-ba14-4e8c-9082-fa77713df0f4 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:20.880359 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-e1d4b976-ba14-4e8c-9082-fa77713df0f4 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e8c46b1820a4ce5ac853ab1cc88fc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98914183afee4e58ad7a425cb019e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:12:20.889729 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-e1d4b976-ba14-4e8c-9082-fa77713df0f4 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] 10.222.0.13 "GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1" status: 200 len: 1260 microversion: 2.1 time: 0.169634 Jun 07 22:12:20.890953 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 571/1148] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:12:20 2022] GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1 => generated 1260 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:12:21.907460 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-7efec2e5-f2cf-475b-b167-88f83faad074 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:12:21.908016 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-7efec2e5-f2cf-475b-b167-88f83faad074 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] [instance: 4d8ab38f-db6d-4560-962e-c1e55c509ce1] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:12:21.914477 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-7efec2e5-f2cf-475b-b167-88f83faad074 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:21.914929 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-7efec2e5-f2cf-475b-b167-88f83faad074 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:21.915709 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-7efec2e5-f2cf-475b-b167-88f83faad074 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:21.916141 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-7efec2e5-f2cf-475b-b167-88f83faad074 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:22.053131 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-23e9be2f-162f-47af-a8dd-ce4e1708cdf5 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f37bd690-ca7f-49b8-ba42-8b0e11592898"}} {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:12:22.055977 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-23e9be2f-162f-47af-a8dd-ce4e1708cdf5 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: b8a810a4-60df-4062-baae-8f11e0615a49] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:12:22.062513 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-23e9be2f-162f-47af-a8dd-ce4e1708cdf5 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:22.063234 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-23e9be2f-162f-47af-a8dd-ce4e1708cdf5 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:22.064052 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-23e9be2f-162f-47af-a8dd-ce4e1708cdf5 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:22.064488 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-23e9be2f-162f-47af-a8dd-ce4e1708cdf5 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:22.070050 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-7efec2e5-f2cf-475b-b167-88f83faad074 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e8c46b1820a4ce5ac853ab1cc88fc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98914183afee4e58ad7a425cb019e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:12:22.078388 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-7efec2e5-f2cf-475b-b167-88f83faad074 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] 10.222.0.13 "GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1" status: 200 len: 1260 microversion: 2.1 time: 0.175447 Jun 07 22:12:22.079209 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 578/1149] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:12:21 2022] GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1 => generated 1260 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:12:22.149453 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.wsgi [None req-23e9be2f-162f-47af-a8dd-ce4e1708cdf5 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] HTTP exception thrown: Invalid volume: volume f37bd690-ca7f-49b8-ba42-8b0e11592898 is already attached to instances: b8a810a4-60df-4062-baae-8f11e0615a49 Jun 07 22:12:22.151373 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-23e9be2f-162f-47af-a8dd-ce4e1708cdf5 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Request method failure captured: Jun 07 22:12:22.151373 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: request: POST /compute/v2.1/servers/b8a810a4-60df-4062-baae-8f11e0615a49/os-volume_attachments HTTP/1.1 Jun 07 22:12:22.151373 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Accept: application/json Jun 07 22:12:22.151373 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Accept-Encoding: identity Jun 07 22:12:22.151373 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Connection: close Jun 07 22:12:22.151373 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Content-Length: 74 Jun 07 22:12:22.151373 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Content-Type: application/json Jun 07 22:12:22.151373 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Host: 10.222.0.13 Jun 07 22:12:22.151373 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Openstack-System-Scope: None Jun 07 22:12:22.151373 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: User-Agent: python-urllib3/1.26.9 Jun 07 22:12:22.151373 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Auth-Token: gAAAAABin8srQLbStzUvCeAnRNadMyGlcKFPPrFg9QuKcDpjIyywTcK8viTuRoYw24qPuVh7wMg6UWBPhX8hggkc6BZRBiLlvXhF5-X03MFchuLsFFC__9JBLL5O-wkDCN77ZFc33WSFPA37h4CwlIMlU5FumSkwBM-s6ELIPTrdhu_0TKT1s2Y Jun 07 22:12:22.151373 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Domain-Id: None Jun 07 22:12:22.151373 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Domain-Name: None Jun 07 22:12:22.151373 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Identity-Status: Confirmed Jun 07 22:12:22.151373 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Is-Admin-Project: True Jun 07 22:12:22.151373 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Domain-Id: default Jun 07 22:12:22.151373 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Domain-Name: Default Jun 07 22:12:22.151373 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Id: 49d73c22e28a450a99d0952aa686dccf Jun 07 22:12:22.151373 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Name: tempest-AttachVolumeNegativeTest-1740363357 Jun 07 22:12:22.151373 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Role: member,reader Jun 07 22:12:22.151373 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Roles: member,reader Jun 07 22:12:22.152958 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/49d73c22e28a450a99d0952aa686dccf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_49d73c22e28a450a99d0952aa686dccf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/49d73c22e28a450a99d0952aa686dccf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/49d73c22e28a450a99d0952aa686dccf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}] Jun 07 22:12:22.152958 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Tenant: tempest-AttachVolumeNegativeTest-1740363357 Jun 07 22:12:22.152958 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Tenant-Id: 49d73c22e28a450a99d0952aa686dccf Jun 07 22:12:22.152958 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1740363357 Jun 07 22:12:22.152958 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User: tempest-AttachVolumeNegativeTest-1740363357-project Jun 07 22:12:22.152958 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Domain-Id: default Jun 07 22:12:22.152958 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Domain-Name: Default Jun 07 22:12:22.152958 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Id: 607b70b4d6e14c95ae2880dd3577c8ae Jun 07 22:12:22.152958 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Name: tempest-AttachVolumeNegativeTest-1740363357-project Jun 07 22:12:22.152958 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Jun 07 22:12:22.152958 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: {"volumeAttachment": {"volumeId": "f37bd690-ca7f-49b8-ba42-8b0e11592898"}} Jun 07 22:12:22.152958 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: method: > Jun 07 22:12:22.153948 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: exception: Invalid volume: volume f37bd690-ca7f-49b8-ba42-8b0e11592898 is already attached to instances: b8a810a4-60df-4062-baae-8f11e0615a49 Jun 07 22:12:22.153948 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: action_args: {'server_id': 'b8a810a4-60df-4062-baae-8f11e0615a49', 'body': {'volumeAttachment': {'volumeId': 'f37bd690-ca7f-49b8-ba42-8b0e11592898'}}} Jun 07 22:12:22.153948 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 22:12:22.153948 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:12:22.153948 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 07 22:12:22.153948 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 07 22:12:22.153948 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 07 22:12:22.153948 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 07 22:12:22.153948 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 07 22:12:22.153948 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 07 22:12:22.153948 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 07 22:12:22.153948 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 07 22:12:22.153948 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 07 22:12:22.153948 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 07 22:12:22.153948 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume f37bd690-ca7f-49b8-ba42-8b0e11592898 is already attached to instances: b8a810a4-60df-4062-baae-8f11e0615a49 Jun 07 22:12:22.153948 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:12:22.153948 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:12:22.153948 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:12:22.153948 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:12:22.156701 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:12:22.156701 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:12:22.156701 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 22:12:22.156701 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 22:12:22.156701 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 22:12:22.156701 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 22:12:22.156701 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 07 22:12:22.156701 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 22:12:22.156701 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 07 22:12:22.156701 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 22:12:22.156701 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 07 22:12:22.156701 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 22:12:22.156701 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 07 22:12:22.156701 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 07 22:12:22.156701 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume f37bd690-ca7f-49b8-ba42-8b0e11592898 is already attached to instances: b8a810a4-60df-4062-baae-8f11e0615a49 Jun 07 22:12:22.156701 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:12:22.156701 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:12:22.156701 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:12:22.156701 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:12:22.156701 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:12:22.158766 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:12:22.158766 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 22:12:22.158766 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 22:12:22.158766 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume f37bd690-ca7f-49b8-ba42-8b0e11592898 is already attached to instances: b8a810a4-60df-4062-baae-8f11e0615a49 Jun 07 22:12:22.158766 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:12:22.158766 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-23e9be2f-162f-47af-a8dd-ce4e1708cdf5 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Returning 400 to user: Invalid volume: volume f37bd690-ca7f-49b8-ba42-8b0e11592898 is already attached to instances: b8a810a4-60df-4062-baae-8f11e0615a49 {{(pid=117970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 22:12:22.158766 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-23e9be2f-162f-47af-a8dd-ce4e1708cdf5 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "POST /compute/v2.1/servers/b8a810a4-60df-4062-baae-8f11e0615a49/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.103730 Jun 07 22:12:22.158766 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 572/1150] 10.222.0.13 () {60 vars in 1322 bytes} [Tue Jun 7 22:12:22 2022] POST /compute/v2.1/servers/b8a810a4-60df-4062-baae-8f11e0615a49/os-volume_attachments => generated 174 bytes in 105 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 07 22:12:22.215014 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-12d57ae3-2fe5-45da-8854-11376f0aaf0d tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:12:22.215531 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-12d57ae3-2fe5-45da-8854-11376f0aaf0d tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: b8a810a4-60df-4062-baae-8f11e0615a49] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:12:22.221917 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-12d57ae3-2fe5-45da-8854-11376f0aaf0d tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:22.222357 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-12d57ae3-2fe5-45da-8854-11376f0aaf0d tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:22.223099 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-12d57ae3-2fe5-45da-8854-11376f0aaf0d tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:22.223559 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-12d57ae3-2fe5-45da-8854-11376f0aaf0d tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:22.306674 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.objects.instance [None req-12d57ae3-2fe5-45da-8854-11376f0aaf0d tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lazy-loading 'services' on Instance uuid b8a810a4-60df-4062-baae-8f11e0615a49 {{(pid=117971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 22:12:22.378875 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-12d57ae3-2fe5-45da-8854-11376f0aaf0d tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "DELETE /compute/v2.1/servers/b8a810a4-60df-4062-baae-8f11e0615a49/os-volume_attachments/f37bd690-ca7f-49b8-ba42-8b0e11592898" status: 202 len: 0 microversion: 2.1 time: 0.167563 Jun 07 22:12:22.379478 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 579/1151] 10.222.0.13 () {58 vars in 1415 bytes} [Tue Jun 7 22:12:22 2022] DELETE /compute/v2.1/servers/b8a810a4-60df-4062-baae-8f11e0615a49/os-volume_attachments/f37bd690-ca7f-49b8-ba42-8b0e11592898 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 22:12:22.387463 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-f955fb7e-98cc-407a-8535-92131973c012 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:12:22.388392 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-f955fb7e-98cc-407a-8535-92131973c012 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: b8a810a4-60df-4062-baae-8f11e0615a49] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:12:22.395708 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f955fb7e-98cc-407a-8535-92131973c012 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:22.396153 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f955fb7e-98cc-407a-8535-92131973c012 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:22.396904 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f955fb7e-98cc-407a-8535-92131973c012 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:22.397333 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f955fb7e-98cc-407a-8535-92131973c012 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:22.426094 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-f955fb7e-98cc-407a-8535-92131973c012 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/b8a810a4-60df-4062-baae-8f11e0615a49/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042402 Jun 07 22:12:22.426722 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 573/1152] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jun 7 22:12:22 2022] GET /compute/v2.1/servers/b8a810a4-60df-4062-baae-8f11e0615a49/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:12:23.096877 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-154a7b91-9af0-4120-91f1-23a5298d8aa9 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:12:23.097678 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-154a7b91-9af0-4120-91f1-23a5298d8aa9 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] [instance: 4d8ab38f-db6d-4560-962e-c1e55c509ce1] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:12:23.104075 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-154a7b91-9af0-4120-91f1-23a5298d8aa9 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:23.104517 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-154a7b91-9af0-4120-91f1-23a5298d8aa9 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:23.105270 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-154a7b91-9af0-4120-91f1-23a5298d8aa9 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:23.105701 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-154a7b91-9af0-4120-91f1-23a5298d8aa9 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:23.242727 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-154a7b91-9af0-4120-91f1-23a5298d8aa9 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e8c46b1820a4ce5ac853ab1cc88fc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98914183afee4e58ad7a425cb019e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:12:23.251085 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-154a7b91-9af0-4120-91f1-23a5298d8aa9 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] 10.222.0.13 "GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1" status: 200 len: 1260 microversion: 2.1 time: 0.159659 Jun 07 22:12:23.251840 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 580/1153] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:12:23 2022] GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:12:23.438218 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-a8414344-3bb9-45b1-a3a7-c955a09ab083 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:12:23.440116 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-a8414344-3bb9-45b1-a3a7-c955a09ab083 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: b8a810a4-60df-4062-baae-8f11e0615a49] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:12:23.447548 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a8414344-3bb9-45b1-a3a7-c955a09ab083 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:23.448096 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a8414344-3bb9-45b1-a3a7-c955a09ab083 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:23.448931 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a8414344-3bb9-45b1-a3a7-c955a09ab083 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:23.449473 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a8414344-3bb9-45b1-a3a7-c955a09ab083 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:23.479724 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-a8414344-3bb9-45b1-a3a7-c955a09ab083 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/b8a810a4-60df-4062-baae-8f11e0615a49/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045598 Jun 07 22:12:23.480367 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 574/1154] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jun 7 22:12:23 2022] GET /compute/v2.1/servers/b8a810a4-60df-4062-baae-8f11e0615a49/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:12:24.268351 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-02cdec9f-4877-4e65-9cec-df23433d459d tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:12:24.268916 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-02cdec9f-4877-4e65-9cec-df23433d459d tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] [instance: 4d8ab38f-db6d-4560-962e-c1e55c509ce1] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:12:24.275736 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-02cdec9f-4877-4e65-9cec-df23433d459d tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:24.276317 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-02cdec9f-4877-4e65-9cec-df23433d459d tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:24.277077 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-02cdec9f-4877-4e65-9cec-df23433d459d tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:24.277562 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-02cdec9f-4877-4e65-9cec-df23433d459d tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:24.430250 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-02cdec9f-4877-4e65-9cec-df23433d459d tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e8c46b1820a4ce5ac853ab1cc88fc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98914183afee4e58ad7a425cb019e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:12:24.439721 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-02cdec9f-4877-4e65-9cec-df23433d459d tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] 10.222.0.13 "GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1" status: 200 len: 1260 microversion: 2.1 time: 0.175696 Jun 07 22:12:24.440349 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 581/1155] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:12:24 2022] GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1 => generated 1260 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:12:24.491114 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-d42c0295-5417-40c1-b8c2-4107f71e788d tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:12:24.492084 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-d42c0295-5417-40c1-b8c2-4107f71e788d tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: b8a810a4-60df-4062-baae-8f11e0615a49] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:12:24.498347 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d42c0295-5417-40c1-b8c2-4107f71e788d tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:24.498818 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d42c0295-5417-40c1-b8c2-4107f71e788d tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:24.500147 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d42c0295-5417-40c1-b8c2-4107f71e788d tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:24.500553 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d42c0295-5417-40c1-b8c2-4107f71e788d tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:24.529785 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-d42c0295-5417-40c1-b8c2-4107f71e788d tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/b8a810a4-60df-4062-baae-8f11e0615a49/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042521 Jun 07 22:12:24.530536 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 575/1156] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jun 7 22:12:24 2022] GET /compute/v2.1/servers/b8a810a4-60df-4062-baae-8f11e0615a49/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 07 22:12:24.589666 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-36b69927-96e7-4198-bb01-0f741efe3933 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:12:24.590157 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-36b69927-96e7-4198-bb01-0f741efe3933 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: b8a810a4-60df-4062-baae-8f11e0615a49] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:12:24.597778 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-36b69927-96e7-4198-bb01-0f741efe3933 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:24.598236 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-36b69927-96e7-4198-bb01-0f741efe3933 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:24.599001 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-36b69927-96e7-4198-bb01-0f741efe3933 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:24.599468 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-36b69927-96e7-4198-bb01-0f741efe3933 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:24.625370 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-36b69927-96e7-4198-bb01-0f741efe3933 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: b8a810a4-60df-4062-baae-8f11e0615a49] Going to try to terminate instance {{(pid=117971) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 22:12:24.705763 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-36b69927-96e7-4198-bb01-0f741efe3933 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "DELETE /compute/v2.1/servers/b8a810a4-60df-4062-baae-8f11e0615a49" status: 204 len: 0 microversion: 2.1 time: 0.119685 Jun 07 22:12:24.712796 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 582/1157] 10.222.0.13 () {58 vars in 1238 bytes} [Tue Jun 7 22:12:24 2022] DELETE /compute/v2.1/servers/b8a810a4-60df-4062-baae-8f11e0615a49 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 22:12:24.714910 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-874ea2fe-58e4-406e-9337-7691a78db1ac tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:12:24.715458 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-874ea2fe-58e4-406e-9337-7691a78db1ac tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: b8a810a4-60df-4062-baae-8f11e0615a49] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:12:24.721747 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-874ea2fe-58e4-406e-9337-7691a78db1ac tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:24.722244 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-874ea2fe-58e4-406e-9337-7691a78db1ac tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:24.723040 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-874ea2fe-58e4-406e-9337-7691a78db1ac tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:24.723517 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-874ea2fe-58e4-406e-9337-7691a78db1ac tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:24.862221 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-874ea2fe-58e4-406e-9337-7691a78db1ac tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:12:24.869777 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-874ea2fe-58e4-406e-9337-7691a78db1ac tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/b8a810a4-60df-4062-baae-8f11e0615a49" status: 200 len: 1682 microversion: 2.1 time: 0.159247 Jun 07 22:12:24.870463 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 576/1158] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:12:24 2022] GET /compute/v2.1/servers/b8a810a4-60df-4062-baae-8f11e0615a49 => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:12:25.456000 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-5947a8dc-284c-4cb1-9cc6-1f9ca8b5f49b tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:12:25.456687 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-5947a8dc-284c-4cb1-9cc6-1f9ca8b5f49b tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] [instance: 4d8ab38f-db6d-4560-962e-c1e55c509ce1] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:12:25.463018 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-5947a8dc-284c-4cb1-9cc6-1f9ca8b5f49b tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:25.463495 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-5947a8dc-284c-4cb1-9cc6-1f9ca8b5f49b tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:25.464254 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-5947a8dc-284c-4cb1-9cc6-1f9ca8b5f49b tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:25.464679 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-5947a8dc-284c-4cb1-9cc6-1f9ca8b5f49b tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:25.650329 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-5947a8dc-284c-4cb1-9cc6-1f9ca8b5f49b tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e8c46b1820a4ce5ac853ab1cc88fc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98914183afee4e58ad7a425cb019e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:12:25.658808 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-5947a8dc-284c-4cb1-9cc6-1f9ca8b5f49b tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] 10.222.0.13 "GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1" status: 200 len: 1260 microversion: 2.1 time: 0.207039 Jun 07 22:12:25.659690 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 583/1159] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:12:25 2022] GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1 => generated 1260 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:12:25.888223 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-f4433c51-7f91-4ab1-9c05-48b2e0d96c25 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:12:25.888842 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-f4433c51-7f91-4ab1-9c05-48b2e0d96c25 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: b8a810a4-60df-4062-baae-8f11e0615a49] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:12:25.897008 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f4433c51-7f91-4ab1-9c05-48b2e0d96c25 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:25.897559 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f4433c51-7f91-4ab1-9c05-48b2e0d96c25 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:25.898394 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f4433c51-7f91-4ab1-9c05-48b2e0d96c25 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:25.898917 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f4433c51-7f91-4ab1-9c05-48b2e0d96c25 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:26.038046 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-f4433c51-7f91-4ab1-9c05-48b2e0d96c25 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:12:26.045659 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-f4433c51-7f91-4ab1-9c05-48b2e0d96c25 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/b8a810a4-60df-4062-baae-8f11e0615a49" status: 200 len: 1682 microversion: 2.1 time: 0.161921 Jun 07 22:12:26.046355 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 577/1160] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:12:25 2022] GET /compute/v2.1/servers/b8a810a4-60df-4062-baae-8f11e0615a49 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:12:26.675837 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-034423c1-ec57-4b03-90ac-9f06f77539f3 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:12:26.676447 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-034423c1-ec57-4b03-90ac-9f06f77539f3 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] [instance: 4d8ab38f-db6d-4560-962e-c1e55c509ce1] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:12:26.683569 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-034423c1-ec57-4b03-90ac-9f06f77539f3 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:26.684092 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-034423c1-ec57-4b03-90ac-9f06f77539f3 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:26.684878 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-034423c1-ec57-4b03-90ac-9f06f77539f3 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:26.685319 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-034423c1-ec57-4b03-90ac-9f06f77539f3 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:26.847121 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-034423c1-ec57-4b03-90ac-9f06f77539f3 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e8c46b1820a4ce5ac853ab1cc88fc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98914183afee4e58ad7a425cb019e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:12:26.855477 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-034423c1-ec57-4b03-90ac-9f06f77539f3 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] 10.222.0.13 "GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1" status: 200 len: 1260 microversion: 2.1 time: 0.184284 Jun 07 22:12:26.856082 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 584/1161] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:12:26 2022] GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1 => generated 1260 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:12:27.064071 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-4ac89a46-1c2b-40de-9dee-2c00d6fc5781 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:12:27.064808 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-4ac89a46-1c2b-40de-9dee-2c00d6fc5781 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: b8a810a4-60df-4062-baae-8f11e0615a49] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:12:27.070901 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4ac89a46-1c2b-40de-9dee-2c00d6fc5781 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:27.071357 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4ac89a46-1c2b-40de-9dee-2c00d6fc5781 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:27.072116 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4ac89a46-1c2b-40de-9dee-2c00d6fc5781 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:27.072542 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4ac89a46-1c2b-40de-9dee-2c00d6fc5781 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:27.276916 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-4ac89a46-1c2b-40de-9dee-2c00d6fc5781 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:12:27.285599 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-4ac89a46-1c2b-40de-9dee-2c00d6fc5781 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/b8a810a4-60df-4062-baae-8f11e0615a49" status: 200 len: 1682 microversion: 2.1 time: 0.226648 Jun 07 22:12:27.286167 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 578/1162] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:12:27 2022] GET /compute/v2.1/servers/b8a810a4-60df-4062-baae-8f11e0615a49 => generated 1682 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:12:27.794514 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [req-4ba74bcf-72c8-48e9-a1d5-ae68ec8850d8 req-cb394500-b07c-4f0d-98e1-4a86b7811849 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8a810a4-60df-4062-baae-8f11e0615a49", "name": "network-vif-deleted", "tag": "8024526f-033a-4156-9ee3-19096f0790de"}]} {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:12:27.809382 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-4ba74bcf-72c8-48e9-a1d5-ae68ec8850d8 req-cb394500-b07c-4f0d-98e1-4a86b7811849 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:27.810245 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-4ba74bcf-72c8-48e9-a1d5-ae68ec8850d8 req-cb394500-b07c-4f0d-98e1-4a86b7811849 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:27.865740 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.compute.server_external_events [req-4ba74bcf-72c8-48e9-a1d5-ae68ec8850d8 req-cb394500-b07c-4f0d-98e1-4a86b7811849 service nova] Creating event network-vif-deleted:8024526f-033a-4156-9ee3-19096f0790de for instance b8a810a4-60df-4062-baae-8f11e0615a49 on hv-cinder-83552 Jun 07 22:12:27.874684 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-025ea4a8-473d-4682-96b2-d08fed24b9ce tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:12:27.875857 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-025ea4a8-473d-4682-96b2-d08fed24b9ce tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] [instance: 4d8ab38f-db6d-4560-962e-c1e55c509ce1] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:12:27.883933 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [req-4ba74bcf-72c8-48e9-a1d5-ae68ec8850d8 req-cb394500-b07c-4f0d-98e1-4a86b7811849 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094778 Jun 07 22:12:27.885188 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 585/1163] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:12:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:12:27.888523 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-025ea4a8-473d-4682-96b2-d08fed24b9ce tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:27.888978 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-025ea4a8-473d-4682-96b2-d08fed24b9ce tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:27.889809 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-025ea4a8-473d-4682-96b2-d08fed24b9ce tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:27.890251 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-025ea4a8-473d-4682-96b2-d08fed24b9ce tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:28.054707 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [req-03ee2ec6-bd6e-453a-94ee-0841e6227595 req-aa556fac-bc29-4c00-858c-342067db3ee4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d8ab38f-db6d-4560-962e-c1e55c509ce1", "name": "network-vif-plugged", "status": "completed", "tag": "c6cae0af-2220-44aa-8bba-70f301632681"}]} {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:12:28.082785 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-03ee2ec6-bd6e-453a-94ee-0841e6227595 req-aa556fac-bc29-4c00-858c-342067db3ee4 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:28.083267 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-03ee2ec6-bd6e-453a-94ee-0841e6227595 req-aa556fac-bc29-4c00-858c-342067db3ee4 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:28.099947 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-025ea4a8-473d-4682-96b2-d08fed24b9ce tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e8c46b1820a4ce5ac853ab1cc88fc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98914183afee4e58ad7a425cb019e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:12:28.101718 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.compute.server_external_events [req-03ee2ec6-bd6e-453a-94ee-0841e6227595 req-aa556fac-bc29-4c00-858c-342067db3ee4 service nova] Creating event network-vif-plugged:c6cae0af-2220-44aa-8bba-70f301632681 for instance 4d8ab38f-db6d-4560-962e-c1e55c509ce1 on hv-cinder-83552 Jun 07 22:12:28.114897 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-025ea4a8-473d-4682-96b2-d08fed24b9ce tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] 10.222.0.13 "GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1" status: 200 len: 1260 microversion: 2.1 time: 0.245038 Jun 07 22:12:28.128083 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 579/1164] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:12:27 2022] GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1 => generated 1260 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:12:28.130204 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [req-03ee2ec6-bd6e-453a-94ee-0841e6227595 req-aa556fac-bc29-4c00-858c-342067db3ee4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081245 Jun 07 22:12:28.133541 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 586/1165] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:12:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:12:28.303440 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-fea0f227-b5db-4198-a19b-ce5129fd16fd tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:12:28.304203 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-fea0f227-b5db-4198-a19b-ce5129fd16fd tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: b8a810a4-60df-4062-baae-8f11e0615a49] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:12:28.310450 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-fea0f227-b5db-4198-a19b-ce5129fd16fd tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:28.310910 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-fea0f227-b5db-4198-a19b-ce5129fd16fd tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:28.312414 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-fea0f227-b5db-4198-a19b-ce5129fd16fd tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:28.312913 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-fea0f227-b5db-4198-a19b-ce5129fd16fd tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:28.346162 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-fea0f227-b5db-4198-a19b-ce5129fd16fd tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:28.346608 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-fea0f227-b5db-4198-a19b-ce5129fd16fd tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:28.347267 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.objects.instance [None req-fea0f227-b5db-4198-a19b-ce5129fd16fd tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lazy-loading 'fault' on Instance uuid b8a810a4-60df-4062-baae-8f11e0615a49 {{(pid=117970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 22:12:28.390225 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-fea0f227-b5db-4198-a19b-ce5129fd16fd tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:12:28.399232 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-fea0f227-b5db-4198-a19b-ce5129fd16fd tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/b8a810a4-60df-4062-baae-8f11e0615a49" status: 200 len: 1331 microversion: 2.1 time: 0.100203 Jun 07 22:12:28.399905 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 580/1166] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:12:28 2022] GET /compute/v2.1/servers/b8a810a4-60df-4062-baae-8f11e0615a49 => generated 1331 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:12:29.136896 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-bc9e5278-8f7e-46e1-b227-1dd2ba22f8b9 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:12:29.137504 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-bc9e5278-8f7e-46e1-b227-1dd2ba22f8b9 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] [instance: 4d8ab38f-db6d-4560-962e-c1e55c509ce1] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:12:29.139491 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:12:29.145621 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-bc9e5278-8f7e-46e1-b227-1dd2ba22f8b9 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:29.146072 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-bc9e5278-8f7e-46e1-b227-1dd2ba22f8b9 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:29.146831 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-bc9e5278-8f7e-46e1-b227-1dd2ba22f8b9 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:29.147262 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-bc9e5278-8f7e-46e1-b227-1dd2ba22f8b9 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:29.162947 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:12:29.282481 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-bc9e5278-8f7e-46e1-b227-1dd2ba22f8b9 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e8c46b1820a4ce5ac853ab1cc88fc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98914183afee4e58ad7a425cb019e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:12:29.289867 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-bc9e5278-8f7e-46e1-b227-1dd2ba22f8b9 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] 10.222.0.13 "GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1" status: 200 len: 1260 microversion: 2.1 time: 0.157741 Jun 07 22:12:29.290434 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 587/1167] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:12:29 2022] GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:12:29.416877 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-1dc30a4e-bfd9-485b-af72-3014b222844f tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:12:29.417399 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-1dc30a4e-bfd9-485b-af72-3014b222844f tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: b8a810a4-60df-4062-baae-8f11e0615a49] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:12:29.424685 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1dc30a4e-bfd9-485b-af72-3014b222844f tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:29.425123 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1dc30a4e-bfd9-485b-af72-3014b222844f tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:29.425861 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1dc30a4e-bfd9-485b-af72-3014b222844f tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:29.426287 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1dc30a4e-bfd9-485b-af72-3014b222844f tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:29.440259 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.wsgi [None req-1dc30a4e-bfd9-485b-af72-3014b222844f tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] HTTP exception thrown: Instance b8a810a4-60df-4062-baae-8f11e0615a49 could not be found. Jun 07 22:12:29.441763 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-1dc30a4e-bfd9-485b-af72-3014b222844f tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Request method failure captured: Jun 07 22:12:29.441763 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: request: GET /compute/v2.1/servers/b8a810a4-60df-4062-baae-8f11e0615a49 HTTP/1.1 Jun 07 22:12:29.441763 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Accept: application/json Jun 07 22:12:29.441763 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Accept-Encoding: identity Jun 07 22:12:29.441763 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Connection: close Jun 07 22:12:29.441763 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Content-Length: 0 Jun 07 22:12:29.441763 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Content-Type: application/json Jun 07 22:12:29.441763 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Host: 10.222.0.13 Jun 07 22:12:29.441763 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Openstack-System-Scope: None Jun 07 22:12:29.441763 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: User-Agent: python-urllib3/1.26.9 Jun 07 22:12:29.441763 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Auth-Token: gAAAAABin8srQLbStzUvCeAnRNadMyGlcKFPPrFg9QuKcDpjIyywTcK8viTuRoYw24qPuVh7wMg6UWBPhX8hggkc6BZRBiLlvXhF5-X03MFchuLsFFC__9JBLL5O-wkDCN77ZFc33WSFPA37h4CwlIMlU5FumSkwBM-s6ELIPTrdhu_0TKT1s2Y Jun 07 22:12:29.441763 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Domain-Id: None Jun 07 22:12:29.441763 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Domain-Name: None Jun 07 22:12:29.441763 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Identity-Status: Confirmed Jun 07 22:12:29.441763 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Is-Admin-Project: True Jun 07 22:12:29.441763 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Domain-Id: default Jun 07 22:12:29.441763 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Domain-Name: Default Jun 07 22:12:29.441763 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Id: 49d73c22e28a450a99d0952aa686dccf Jun 07 22:12:29.441763 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Name: tempest-AttachVolumeNegativeTest-1740363357 Jun 07 22:12:29.441763 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Role: member,reader Jun 07 22:12:29.441763 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Roles: member,reader Jun 07 22:12:29.443359 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/49d73c22e28a450a99d0952aa686dccf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_49d73c22e28a450a99d0952aa686dccf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/49d73c22e28a450a99d0952aa686dccf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/49d73c22e28a450a99d0952aa686dccf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}] Jun 07 22:12:29.443359 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Tenant: tempest-AttachVolumeNegativeTest-1740363357 Jun 07 22:12:29.443359 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Tenant-Id: 49d73c22e28a450a99d0952aa686dccf Jun 07 22:12:29.443359 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1740363357 Jun 07 22:12:29.443359 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User: tempest-AttachVolumeNegativeTest-1740363357-project Jun 07 22:12:29.443359 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Domain-Id: default Jun 07 22:12:29.443359 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Domain-Name: Default Jun 07 22:12:29.443359 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Id: 607b70b4d6e14c95ae2880dd3577c8ae Jun 07 22:12:29.443359 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Name: tempest-AttachVolumeNegativeTest-1740363357-project Jun 07 22:12:29.443359 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: method: > Jun 07 22:12:29.443359 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: exception: Instance b8a810a4-60df-4062-baae-8f11e0615a49 could not be found. Jun 07 22:12:29.443359 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: action_args: {'id': 'b8a810a4-60df-4062-baae-8f11e0615a49'} Jun 07 22:12:29.444329 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 22:12:29.444329 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:12:29.444329 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 22:12:29.444329 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 22:12:29.444329 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 22:12:29.444329 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 22:12:29.444329 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 22:12:29.444329 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 22:12:29.444329 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 22:12:29.444329 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 22:12:29.444329 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8a810a4-60df-4062-baae-8f11e0615a49 could not be found. Jun 07 22:12:29.444329 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:12:29.444329 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:12:29.444329 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:12:29.444329 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:12:29.444329 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:12:29.444329 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:12:29.444329 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 22:12:29.444329 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 22:12:29.444329 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 22:12:29.445830 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 22:12:29.445830 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 22:12:29.445830 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 22:12:29.445830 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 22:12:29.445830 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 22:12:29.445830 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 22:12:29.445830 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 22:12:29.445830 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8a810a4-60df-4062-baae-8f11e0615a49 could not be found. Jun 07 22:12:29.445830 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:12:29.445830 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:12:29.445830 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:12:29.445830 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:12:29.445830 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:12:29.445830 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:12:29.445830 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 22:12:29.445830 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 22:12:29.445830 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8a810a4-60df-4062-baae-8f11e0615a49 could not be found. Jun 07 22:12:29.445830 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:12:29.447449 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-1dc30a4e-bfd9-485b-af72-3014b222844f tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Returning 404 to user: Instance b8a810a4-60df-4062-baae-8f11e0615a49 could not be found. {{(pid=117970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 22:12:29.447449 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-1dc30a4e-bfd9-485b-af72-3014b222844f tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/b8a810a4-60df-4062-baae-8f11e0615a49" status: 404 len: 111 microversion: 2.1 time: 0.030174 Jun 07 22:12:29.447449 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 581/1168] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:12:29 2022] GET /compute/v2.1/servers/b8a810a4-60df-4062-baae-8f11e0615a49 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 22:12:29.451839 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-80b73375-a1ad-45d6-a38a-ebe4458f6220 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '.version_select at 0x7f92f13fb9d0>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:12:29.468245 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-80b73375-a1ad-45d6-a38a-ebe4458f6220 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-615576509" status: 202 len: 0 microversion: 2.1 time: 0.020143 Jun 07 22:12:29.468801 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 588/1169] 10.222.0.13 () {58 vars in 1217 bytes} [Tue Jun 7 22:12:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-615576509 => generated 0 bytes in 21 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 22:12:30.104902 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-5f192862-9ae9-420e-bd08-345a0d9ae9a4 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Action: 'create', calling method: .version_select at 0x7f92f10d3dc0>, body: {"keypair": {"name": "tempest-keypair-516587500", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPHdmnOHpJBBSWr62WWcfMgV3UVbBvOw4blZyLBMs9smBcy/JS/44ImfLu5nvdgEz6bfPEQyg3uj8sV7MLr8zJ668JA4FvN40/bqNSogdIyBYcKXj+/dPu5tNph4xYzYLA=="}} {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:12:30.119348 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.quota [None req-5f192862-9ae9-420e-bd08-345a0d9ae9a4 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Getting quotas for project 49d73c22e28a450a99d0952aa686dccf. Resources: {'key_pairs'} {{(pid=117970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 22:12:30.123036 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.quota [None req-5f192862-9ae9-420e-bd08-345a0d9ae9a4 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Getting quotas for user 607b70b4d6e14c95ae2880dd3577c8ae and project 49d73c22e28a450a99d0952aa686dccf. Resources: {'key_pairs'} {{(pid=117970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 22:12:30.144597 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-5f192862-9ae9-420e-bd08-345a0d9ae9a4 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.043866 Jun 07 22:12:30.145183 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 582/1170] 10.222.0.13 () {60 vars in 1158 bytes} [Tue Jun 7 22:12:30 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:12:30.307469 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-b0a865aa-b0f1-490f-9c95-df5deb84fdbc tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:12:30.308088 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-b0a865aa-b0f1-490f-9c95-df5deb84fdbc tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] [instance: 4d8ab38f-db6d-4560-962e-c1e55c509ce1] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:12:30.315039 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b0a865aa-b0f1-490f-9c95-df5deb84fdbc tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:30.315527 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b0a865aa-b0f1-490f-9c95-df5deb84fdbc tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:30.316291 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b0a865aa-b0f1-490f-9c95-df5deb84fdbc tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:30.316731 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b0a865aa-b0f1-490f-9c95-df5deb84fdbc tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:30.511172 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-b0a865aa-b0f1-490f-9c95-df5deb84fdbc tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e8c46b1820a4ce5ac853ab1cc88fc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98914183afee4e58ad7a425cb019e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:12:30.518879 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-b0a865aa-b0f1-490f-9c95-df5deb84fdbc tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] 10.222.0.13 "GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1" status: 200 len: 1260 microversion: 2.1 time: 0.215825 Jun 07 22:12:30.519490 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 589/1171] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:12:30 2022] GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1 => generated 1260 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:12:31.536462 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-1a874f83-3b19-49b9-ac38-a8badfcee6a3 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:12:31.537068 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-1a874f83-3b19-49b9-ac38-a8badfcee6a3 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] [instance: 4d8ab38f-db6d-4560-962e-c1e55c509ce1] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:12:31.542897 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1a874f83-3b19-49b9-ac38-a8badfcee6a3 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:31.543369 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1a874f83-3b19-49b9-ac38-a8badfcee6a3 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:31.544137 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1a874f83-3b19-49b9-ac38-a8badfcee6a3 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:31.544573 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1a874f83-3b19-49b9-ac38-a8badfcee6a3 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:31.564011 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-69c20b1d-4dcd-41e5-9d6c-46976f6a3211 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1538514576", "imageRef": "87e2e140-6de8-4531-9681-d0a3e069622d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7dfa279a-8a9f-49b5-8669-931f3a43bf9f"}], "security_groups": [{"name": "tempest-securitygroup--165000280"}], "key_name": "tempest-keypair-516587500", "user_data": "}} {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:12:31.670535 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.network.neutron [None req-69c20b1d-4dcd-41e5-9d6c-46976f6a3211 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] validate_networks() for [('7dfa279a-8a9f-49b5-8669-931f3a43bf9f', None, None, None, None, None)] {{(pid=117971) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 22:12:31.678977 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-1a874f83-3b19-49b9-ac38-a8badfcee6a3 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e8c46b1820a4ce5ac853ab1cc88fc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98914183afee4e58ad7a425cb019e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:12:31.687401 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-1a874f83-3b19-49b9-ac38-a8badfcee6a3 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] 10.222.0.13 "GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1" status: 200 len: 1444 microversion: 2.1 time: 0.154825 Jun 07 22:12:31.688057 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 583/1172] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:12:31 2022] GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1 => generated 1444 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:12:31.703572 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-75680383-93a1-4119-a897-0439cf8447b3 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:12:31.704214 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-75680383-93a1-4119-a897-0439cf8447b3 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] [instance: 4d8ab38f-db6d-4560-962e-c1e55c509ce1] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:12:31.710259 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-75680383-93a1-4119-a897-0439cf8447b3 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:31.710831 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-75680383-93a1-4119-a897-0439cf8447b3 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:31.711624 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-75680383-93a1-4119-a897-0439cf8447b3 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:31.712099 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-75680383-93a1-4119-a897-0439cf8447b3 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:31.730879 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_cell1:SELECT=100 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:12:31.847755 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-75680383-93a1-4119-a897-0439cf8447b3 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e8c46b1820a4ce5ac853ab1cc88fc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98914183afee4e58ad7a425cb019e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:12:31.855558 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-75680383-93a1-4119-a897-0439cf8447b3 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] 10.222.0.13 "GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1" status: 200 len: 1444 microversion: 2.1 time: 0.156336 Jun 07 22:12:31.856212 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 584/1173] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:12:31 2022] GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1 => generated 1444 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:12:32.054759 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.virt.hardware [None req-69c20b1d-4dcd-41e5-9d6c-46976f6a3211 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Flavor limits 0:0:0 {{(pid=117971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 22:12:32.055170 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.virt.hardware [None req-69c20b1d-4dcd-41e5-9d6c-46976f6a3211 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Image limits 0:0:0 {{(pid=117971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 22:12:32.055668 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.virt.hardware [None req-69c20b1d-4dcd-41e5-9d6c-46976f6a3211 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Flavor pref 0:0:0 {{(pid=117971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 22:12:32.056085 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.virt.hardware [None req-69c20b1d-4dcd-41e5-9d6c-46976f6a3211 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Image pref 0:0:0 {{(pid=117971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 22:12:32.056473 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.virt.hardware [None req-69c20b1d-4dcd-41e5-9d6c-46976f6a3211 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 22:12:32.066235 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-69c20b1d-4dcd-41e5-9d6c-46976f6a3211 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:32.066907 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-69c20b1d-4dcd-41e5-9d6c-46976f6a3211 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:32.067969 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-69c20b1d-4dcd-41e5-9d6c-46976f6a3211 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:32.068574 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-69c20b1d-4dcd-41e5-9d6c-46976f6a3211 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:32.086246 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.quota [None req-69c20b1d-4dcd-41e5-9d6c-46976f6a3211 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Getting quotas for project 49d73c22e28a450a99d0952aa686dccf. Resources: {'cores', 'ram', 'instances'} {{(pid=117971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 22:12:32.090724 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.quota [None req-69c20b1d-4dcd-41e5-9d6c-46976f6a3211 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Getting quotas for user 607b70b4d6e14c95ae2880dd3577c8ae and project 49d73c22e28a450a99d0952aa686dccf. Resources: {'cores', 'ram', 'instances'} {{(pid=117971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 22:12:32.103891 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-69c20b1d-4dcd-41e5-9d6c-46976f6a3211 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Going to run 1 instances... {{(pid=117971) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 22:12:32.106146 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-69c20b1d-4dcd-41e5-9d6c-46976f6a3211 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 994885ff-724e-44e8-8c8f-1150c334e1fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='87e2e140-6de8-4531-9681-d0a3e069622d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 22:12:32.160808 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-69c20b1d-4dcd-41e5-9d6c-46976f6a3211 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.601453 Jun 07 22:12:32.162057 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 590/1174] 10.222.0.13 () {60 vars in 1146 bytes} [Tue Jun 7 22:12:31 2022] POST /compute/v2.1/servers => generated 401 bytes in 604 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 07 22:12:32.174993 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-0a1b5339-7613-4df0-a346-f14ce208e8a2 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:12:32.175898 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-0a1b5339-7613-4df0-a346-f14ce208e8a2 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 994885ff-724e-44e8-8c8f-1150c334e1fe] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:12:32.265094 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-0a1b5339-7613-4df0-a346-f14ce208e8a2 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:12:32.275699 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-0a1b5339-7613-4df0-a346-f14ce208e8a2 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/994885ff-724e-44e8-8c8f-1150c334e1fe" status: 200 len: 1241 microversion: 2.1 time: 0.107333 Jun 07 22:12:32.277317 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 585/1175] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:12:32 2022] GET /compute/v2.1/servers/994885ff-724e-44e8-8c8f-1150c334e1fe => generated 1241 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:12:33.301606 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-9b72d578-a3f2-470f-b3db-2651eb3dce98 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:12:33.303260 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-9b72d578-a3f2-470f-b3db-2651eb3dce98 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 994885ff-724e-44e8-8c8f-1150c334e1fe] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:12:33.313649 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-9b72d578-a3f2-470f-b3db-2651eb3dce98 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:33.314859 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-9b72d578-a3f2-470f-b3db-2651eb3dce98 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:33.315831 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-9b72d578-a3f2-470f-b3db-2651eb3dce98 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:33.316456 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-9b72d578-a3f2-470f-b3db-2651eb3dce98 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:33.454712 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-9b72d578-a3f2-470f-b3db-2651eb3dce98 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:12:33.465867 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-9b72d578-a3f2-470f-b3db-2651eb3dce98 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/994885ff-724e-44e8-8c8f-1150c334e1fe" status: 200 len: 1311 microversion: 2.1 time: 0.175234 Jun 07 22:12:33.467060 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 591/1176] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:12:33 2022] GET /compute/v2.1/servers/994885ff-724e-44e8-8c8f-1150c334e1fe => generated 1311 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:12:33.837949 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [req-5afa0b05-8030-4b43-803f-346f8d732de4 req-1b258fe3-3687-42cb-bba9-6cd16c34c1bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d8ab38f-db6d-4560-962e-c1e55c509ce1", "tag": "c6cae0af-2220-44aa-8bba-70f301632681"}]} {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:12:33.848820 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [req-5afa0b05-8030-4b43-803f-346f8d732de4 req-1b258fe3-3687-42cb-bba9-6cd16c34c1bb service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:33.849262 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [req-5afa0b05-8030-4b43-803f-346f8d732de4 req-1b258fe3-3687-42cb-bba9-6cd16c34c1bb service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:33.861043 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.compute.server_external_events [req-5afa0b05-8030-4b43-803f-346f8d732de4 req-1b258fe3-3687-42cb-bba9-6cd16c34c1bb service nova] Creating event network-changed:c6cae0af-2220-44aa-8bba-70f301632681 for instance 4d8ab38f-db6d-4560-962e-c1e55c509ce1 on hv-cinder-83552 Jun 07 22:12:33.866109 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [req-5afa0b05-8030-4b43-803f-346f8d732de4 req-1b258fe3-3687-42cb-bba9-6cd16c34c1bb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031751 Jun 07 22:12:33.866993 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 586/1177] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:12:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:12:34.484803 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-8f528159-60c5-4b1a-9743-62a9b7f8947d tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:12:34.486113 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-8f528159-60c5-4b1a-9743-62a9b7f8947d tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 994885ff-724e-44e8-8c8f-1150c334e1fe] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:12:34.494960 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-8f528159-60c5-4b1a-9743-62a9b7f8947d tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:34.495444 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-8f528159-60c5-4b1a-9743-62a9b7f8947d tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:34.496364 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-8f528159-60c5-4b1a-9743-62a9b7f8947d tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:34.496799 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-8f528159-60c5-4b1a-9743-62a9b7f8947d tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:34.663926 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-8f528159-60c5-4b1a-9743-62a9b7f8947d tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:12:34.673857 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-8f528159-60c5-4b1a-9743-62a9b7f8947d tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/994885ff-724e-44e8-8c8f-1150c334e1fe" status: 200 len: 1366 microversion: 2.1 time: 0.193495 Jun 07 22:12:34.674441 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 592/1178] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:12:34 2022] GET /compute/v2.1/servers/994885ff-724e-44e8-8c8f-1150c334e1fe => generated 1366 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:12:35.692664 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-a5f7409a-30f4-48cd-8854-5739c5058bc5 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:12:35.693354 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-a5f7409a-30f4-48cd-8854-5739c5058bc5 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 994885ff-724e-44e8-8c8f-1150c334e1fe] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:12:35.699559 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a5f7409a-30f4-48cd-8854-5739c5058bc5 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:35.700009 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a5f7409a-30f4-48cd-8854-5739c5058bc5 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:35.700762 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a5f7409a-30f4-48cd-8854-5739c5058bc5 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:35.701195 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a5f7409a-30f4-48cd-8854-5739c5058bc5 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:35.839149 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-a5f7409a-30f4-48cd-8854-5739c5058bc5 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:12:35.846674 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-a5f7409a-30f4-48cd-8854-5739c5058bc5 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/994885ff-724e-44e8-8c8f-1150c334e1fe" status: 200 len: 1366 microversion: 2.1 time: 0.158711 Jun 07 22:12:35.847236 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 587/1179] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:12:35 2022] GET /compute/v2.1/servers/994885ff-724e-44e8-8c8f-1150c334e1fe => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:12:36.863871 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-387c9946-8024-46e4-8b34-45835374d2c0 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:12:36.864757 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-387c9946-8024-46e4-8b34-45835374d2c0 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 994885ff-724e-44e8-8c8f-1150c334e1fe] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:12:36.871550 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-387c9946-8024-46e4-8b34-45835374d2c0 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:36.872210 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-387c9946-8024-46e4-8b34-45835374d2c0 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:36.873014 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-387c9946-8024-46e4-8b34-45835374d2c0 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:36.873452 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-387c9946-8024-46e4-8b34-45835374d2c0 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:37.018815 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-387c9946-8024-46e4-8b34-45835374d2c0 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:12:37.026806 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-387c9946-8024-46e4-8b34-45835374d2c0 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/994885ff-724e-44e8-8c8f-1150c334e1fe" status: 200 len: 1366 microversion: 2.1 time: 0.167167 Jun 07 22:12:37.027480 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 593/1180] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:12:36 2022] GET /compute/v2.1/servers/994885ff-724e-44e8-8c8f-1150c334e1fe => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:12:37.503179 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [req-1e9ea6c2-7053-46f4-a248-0ff677b37d4d req-f64e40d9-9d90-45b3-a6ea-2630d2d91e05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "994885ff-724e-44e8-8c8f-1150c334e1fe", "tag": "1b3e54fe-3bfd-42a2-a29d-62eb36391997"}]} {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:12:37.523463 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [req-1e9ea6c2-7053-46f4-a248-0ff677b37d4d req-f64e40d9-9d90-45b3-a6ea-2630d2d91e05 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:37.523910 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [req-1e9ea6c2-7053-46f4-a248-0ff677b37d4d req-f64e40d9-9d90-45b3-a6ea-2630d2d91e05 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:37.535938 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.compute.server_external_events [req-1e9ea6c2-7053-46f4-a248-0ff677b37d4d req-f64e40d9-9d90-45b3-a6ea-2630d2d91e05 service nova] Creating event network-changed:1b3e54fe-3bfd-42a2-a29d-62eb36391997 for instance 994885ff-724e-44e8-8c8f-1150c334e1fe on hv-cinder-83552 Jun 07 22:12:37.542155 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [req-1e9ea6c2-7053-46f4-a248-0ff677b37d4d req-f64e40d9-9d90-45b3-a6ea-2630d2d91e05 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052726 Jun 07 22:12:37.542767 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 588/1181] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:12:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:12:38.044477 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-1d8f3b39-4375-4eb3-9ac9-0c087bbf3b9d tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:12:38.045093 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-1d8f3b39-4375-4eb3-9ac9-0c087bbf3b9d tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 994885ff-724e-44e8-8c8f-1150c334e1fe] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:12:38.053756 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-1d8f3b39-4375-4eb3-9ac9-0c087bbf3b9d tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:38.054219 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-1d8f3b39-4375-4eb3-9ac9-0c087bbf3b9d tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:38.054991 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-1d8f3b39-4375-4eb3-9ac9-0c087bbf3b9d tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:38.055456 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-1d8f3b39-4375-4eb3-9ac9-0c087bbf3b9d tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:38.187655 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-1d8f3b39-4375-4eb3-9ac9-0c087bbf3b9d tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:12:38.195445 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-1d8f3b39-4375-4eb3-9ac9-0c087bbf3b9d tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/994885ff-724e-44e8-8c8f-1150c334e1fe" status: 200 len: 1366 microversion: 2.1 time: 0.154757 Jun 07 22:12:38.196158 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 594/1182] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:12:38 2022] GET /compute/v2.1/servers/994885ff-724e-44e8-8c8f-1150c334e1fe => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:12:39.213811 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-e6d17cd3-d7c7-4ae5-8119-d376889ade64 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:12:39.214507 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-e6d17cd3-d7c7-4ae5-8119-d376889ade64 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 994885ff-724e-44e8-8c8f-1150c334e1fe] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:12:39.216955 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=4 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:12:39.222897 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e6d17cd3-d7c7-4ae5-8119-d376889ade64 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:39.223362 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e6d17cd3-d7c7-4ae5-8119-d376889ade64 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:39.224131 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e6d17cd3-d7c7-4ae5-8119-d376889ade64 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:39.224570 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e6d17cd3-d7c7-4ae5-8119-d376889ade64 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:39.372669 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-e6d17cd3-d7c7-4ae5-8119-d376889ade64 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:12:39.382536 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-e6d17cd3-d7c7-4ae5-8119-d376889ade64 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/994885ff-724e-44e8-8c8f-1150c334e1fe" status: 200 len: 1366 microversion: 2.1 time: 0.173104 Jun 07 22:12:39.383263 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 589/1183] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:12:39 2022] GET /compute/v2.1/servers/994885ff-724e-44e8-8c8f-1150c334e1fe => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:12:40.401295 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-aefa7e83-06f2-4d5b-aef0-e06d0c840477 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:12:40.401898 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-aefa7e83-06f2-4d5b-aef0-e06d0c840477 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 994885ff-724e-44e8-8c8f-1150c334e1fe] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:12:40.409638 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-aefa7e83-06f2-4d5b-aef0-e06d0c840477 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:40.410081 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-aefa7e83-06f2-4d5b-aef0-e06d0c840477 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:40.410827 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-aefa7e83-06f2-4d5b-aef0-e06d0c840477 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:40.411259 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-aefa7e83-06f2-4d5b-aef0-e06d0c840477 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:40.549432 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-aefa7e83-06f2-4d5b-aef0-e06d0c840477 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:12:40.556995 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-aefa7e83-06f2-4d5b-aef0-e06d0c840477 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/994885ff-724e-44e8-8c8f-1150c334e1fe" status: 200 len: 1366 microversion: 2.1 time: 0.159499 Jun 07 22:12:40.557752 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 595/1184] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:12:40 2022] GET /compute/v2.1/servers/994885ff-724e-44e8-8c8f-1150c334e1fe => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:12:41.574204 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-5cf6c4df-2f08-481c-a524-9f00ab847680 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:12:41.574825 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-5cf6c4df-2f08-481c-a524-9f00ab847680 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 994885ff-724e-44e8-8c8f-1150c334e1fe] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:12:41.581954 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-5cf6c4df-2f08-481c-a524-9f00ab847680 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:41.582402 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-5cf6c4df-2f08-481c-a524-9f00ab847680 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:41.583148 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-5cf6c4df-2f08-481c-a524-9f00ab847680 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:41.583606 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-5cf6c4df-2f08-481c-a524-9f00ab847680 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:41.715775 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-5cf6c4df-2f08-481c-a524-9f00ab847680 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:12:41.723080 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-5cf6c4df-2f08-481c-a524-9f00ab847680 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/994885ff-724e-44e8-8c8f-1150c334e1fe" status: 200 len: 1366 microversion: 2.1 time: 0.152748 Jun 07 22:12:41.723673 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 590/1185] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:12:41 2022] GET /compute/v2.1/servers/994885ff-724e-44e8-8c8f-1150c334e1fe => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:12:42.740302 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-cceddde0-999e-47a8-8ea7-725b70e3a9d3 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:12:42.740914 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-cceddde0-999e-47a8-8ea7-725b70e3a9d3 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 994885ff-724e-44e8-8c8f-1150c334e1fe] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:12:42.743223 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_cell0:SELECT=2 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:12:42.743911 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_cell0:SELECT=6 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:12:42.750053 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-cceddde0-999e-47a8-8ea7-725b70e3a9d3 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:42.750500 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-cceddde0-999e-47a8-8ea7-725b70e3a9d3 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:42.751256 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-cceddde0-999e-47a8-8ea7-725b70e3a9d3 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:42.751719 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-cceddde0-999e-47a8-8ea7-725b70e3a9d3 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:42.884361 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-cceddde0-999e-47a8-8ea7-725b70e3a9d3 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:12:42.892899 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-cceddde0-999e-47a8-8ea7-725b70e3a9d3 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/994885ff-724e-44e8-8c8f-1150c334e1fe" status: 200 len: 1366 microversion: 2.1 time: 0.156373 Jun 07 22:12:42.893662 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 596/1186] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:12:42 2022] GET /compute/v2.1/servers/994885ff-724e-44e8-8c8f-1150c334e1fe => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:12:43.909921 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-5def5b63-2242-4566-88c3-8f73618c445e tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:12:43.910688 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-5def5b63-2242-4566-88c3-8f73618c445e tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 994885ff-724e-44e8-8c8f-1150c334e1fe] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:12:43.912400 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_cell0:SELECT=6 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:12:43.918820 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-5def5b63-2242-4566-88c3-8f73618c445e tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:43.919263 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-5def5b63-2242-4566-88c3-8f73618c445e tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:43.920055 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-5def5b63-2242-4566-88c3-8f73618c445e tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:43.921211 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-5def5b63-2242-4566-88c3-8f73618c445e tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:44.052422 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-5def5b63-2242-4566-88c3-8f73618c445e tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:12:44.059807 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-5def5b63-2242-4566-88c3-8f73618c445e tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/994885ff-724e-44e8-8c8f-1150c334e1fe" status: 200 len: 1366 microversion: 2.1 time: 0.153695 Jun 07 22:12:44.060367 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 591/1187] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:12:43 2022] GET /compute/v2.1/servers/994885ff-724e-44e8-8c8f-1150c334e1fe => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:12:45.075844 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-b037ad9c-c6a7-4535-bece-0c2a2be2da53 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:12:45.076449 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-b037ad9c-c6a7-4535-bece-0c2a2be2da53 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 994885ff-724e-44e8-8c8f-1150c334e1fe] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:12:45.083043 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b037ad9c-c6a7-4535-bece-0c2a2be2da53 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:45.083516 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b037ad9c-c6a7-4535-bece-0c2a2be2da53 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:45.084266 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b037ad9c-c6a7-4535-bece-0c2a2be2da53 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:45.084695 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b037ad9c-c6a7-4535-bece-0c2a2be2da53 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:45.225090 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-b037ad9c-c6a7-4535-bece-0c2a2be2da53 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:12:45.234194 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-b037ad9c-c6a7-4535-bece-0c2a2be2da53 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/994885ff-724e-44e8-8c8f-1150c334e1fe" status: 200 len: 1366 microversion: 2.1 time: 0.161332 Jun 07 22:12:45.235120 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 597/1188] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:12:45 2022] GET /compute/v2.1/servers/994885ff-724e-44e8-8c8f-1150c334e1fe => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:12:46.199668 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [req-ded550e5-4395-4f79-9d63-570ea1d01243 req-6a9650f2-d5d3-49a9-a418-75fbac337ca4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "994885ff-724e-44e8-8c8f-1150c334e1fe", "name": "network-vif-plugged", "status": "completed", "tag": "1b3e54fe-3bfd-42a2-a29d-62eb36391997"}]} {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:12:46.210187 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [req-ded550e5-4395-4f79-9d63-570ea1d01243 req-6a9650f2-d5d3-49a9-a418-75fbac337ca4 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:46.210501 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [req-ded550e5-4395-4f79-9d63-570ea1d01243 req-6a9650f2-d5d3-49a9-a418-75fbac337ca4 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:46.223204 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.compute.server_external_events [req-ded550e5-4395-4f79-9d63-570ea1d01243 req-6a9650f2-d5d3-49a9-a418-75fbac337ca4 service nova] Creating event network-vif-plugged:1b3e54fe-3bfd-42a2-a29d-62eb36391997 for instance 994885ff-724e-44e8-8c8f-1150c334e1fe on hv-cinder-83552 Jun 07 22:12:46.228512 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [req-ded550e5-4395-4f79-9d63-570ea1d01243 req-6a9650f2-d5d3-49a9-a418-75fbac337ca4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032590 Jun 07 22:12:46.229112 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 592/1189] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:12:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:12:46.253137 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-78019880-9ece-472b-aa34-4487302d97f1 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:12:46.253879 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-78019880-9ece-472b-aa34-4487302d97f1 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 994885ff-724e-44e8-8c8f-1150c334e1fe] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:12:46.260592 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-78019880-9ece-472b-aa34-4487302d97f1 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:46.261051 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-78019880-9ece-472b-aa34-4487302d97f1 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:46.261817 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-78019880-9ece-472b-aa34-4487302d97f1 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:46.262255 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-78019880-9ece-472b-aa34-4487302d97f1 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:46.409920 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-78019880-9ece-472b-aa34-4487302d97f1 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:12:46.420168 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-78019880-9ece-472b-aa34-4487302d97f1 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/994885ff-724e-44e8-8c8f-1150c334e1fe" status: 200 len: 1366 microversion: 2.1 time: 0.170791 Jun 07 22:12:46.420757 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 598/1190] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:12:46 2022] GET /compute/v2.1/servers/994885ff-724e-44e8-8c8f-1150c334e1fe => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:12:47.438002 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-6d979b8e-48ed-4c0c-9f35-e9e16bb766f8 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:12:47.438717 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-6d979b8e-48ed-4c0c-9f35-e9e16bb766f8 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 994885ff-724e-44e8-8c8f-1150c334e1fe] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:12:47.444889 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6d979b8e-48ed-4c0c-9f35-e9e16bb766f8 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:47.445276 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6d979b8e-48ed-4c0c-9f35-e9e16bb766f8 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:47.446027 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6d979b8e-48ed-4c0c-9f35-e9e16bb766f8 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:47.446459 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6d979b8e-48ed-4c0c-9f35-e9e16bb766f8 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:47.579001 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-6d979b8e-48ed-4c0c-9f35-e9e16bb766f8 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:12:47.586980 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-6d979b8e-48ed-4c0c-9f35-e9e16bb766f8 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/994885ff-724e-44e8-8c8f-1150c334e1fe" status: 200 len: 1366 microversion: 2.1 time: 0.153679 Jun 07 22:12:47.587629 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 593/1191] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:12:47 2022] GET /compute/v2.1/servers/994885ff-724e-44e8-8c8f-1150c334e1fe => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:12:48.605165 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-f2abfa09-2b3c-4a2d-a517-408de50c5c05 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:12:48.605706 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-f2abfa09-2b3c-4a2d-a517-408de50c5c05 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 994885ff-724e-44e8-8c8f-1150c334e1fe] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:12:48.612359 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-f2abfa09-2b3c-4a2d-a517-408de50c5c05 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:48.612798 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-f2abfa09-2b3c-4a2d-a517-408de50c5c05 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:48.613550 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-f2abfa09-2b3c-4a2d-a517-408de50c5c05 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:48.613979 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-f2abfa09-2b3c-4a2d-a517-408de50c5c05 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:48.758234 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-f2abfa09-2b3c-4a2d-a517-408de50c5c05 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:12:48.766117 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-f2abfa09-2b3c-4a2d-a517-408de50c5c05 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/994885ff-724e-44e8-8c8f-1150c334e1fe" status: 200 len: 1557 microversion: 2.1 time: 0.165065 Jun 07 22:12:48.766736 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 599/1192] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:12:48 2022] GET /compute/v2.1/servers/994885ff-724e-44e8-8c8f-1150c334e1fe => generated 1557 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:12:48.782837 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-ddf46a8b-34ed-42cf-9c38-3943688b7f43 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:12:48.783355 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-ddf46a8b-34ed-42cf-9c38-3943688b7f43 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 994885ff-724e-44e8-8c8f-1150c334e1fe] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:12:48.789884 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-ddf46a8b-34ed-42cf-9c38-3943688b7f43 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:48.790330 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-ddf46a8b-34ed-42cf-9c38-3943688b7f43 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:48.791087 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-ddf46a8b-34ed-42cf-9c38-3943688b7f43 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:48.791560 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-ddf46a8b-34ed-42cf-9c38-3943688b7f43 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:48.870921 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-ddf46a8b-34ed-42cf-9c38-3943688b7f43 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/994885ff-724e-44e8-8c8f-1150c334e1fe/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092131 Jun 07 22:12:48.871552 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 594/1193] 10.222.0.13 () {58 vars in 1274 bytes} [Tue Jun 7 22:12:48 2022] GET /compute/v2.1/servers/994885ff-724e-44e8-8c8f-1150c334e1fe/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:12:49.833441 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [req-4bff1955-d40f-4107-a7f2-1294b103a631 req-77d9271f-fe5f-4e28-af01-10fba226a0f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "994885ff-724e-44e8-8c8f-1150c334e1fe", "tag": "1b3e54fe-3bfd-42a2-a29d-62eb36391997"}]} {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:12:49.842626 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-4bff1955-d40f-4107-a7f2-1294b103a631 req-77d9271f-fe5f-4e28-af01-10fba226a0f5 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:12:49.843118 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-4bff1955-d40f-4107-a7f2-1294b103a631 req-77d9271f-fe5f-4e28-af01-10fba226a0f5 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:12:49.855609 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.compute.server_external_events [req-4bff1955-d40f-4107-a7f2-1294b103a631 req-77d9271f-fe5f-4e28-af01-10fba226a0f5 service nova] Creating event network-changed:1b3e54fe-3bfd-42a2-a29d-62eb36391997 for instance 994885ff-724e-44e8-8c8f-1150c334e1fe on hv-cinder-83552 Jun 07 22:12:49.861728 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [req-4bff1955-d40f-4107-a7f2-1294b103a631 req-77d9271f-fe5f-4e28-af01-10fba226a0f5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031485 Jun 07 22:12:49.862968 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 600/1194] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:12:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:13:15.054042 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_api:SELECT=11 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:13:15.054789 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_cell1:SELECT=42 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:13:15.059305 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-ed3b8c2b-6599-4f7b-86c1-a9b45d2685b7 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:13:15.059813 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-ed3b8c2b-6599-4f7b-86c1-a9b45d2685b7 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: cddfb0ad-63f6-4b0d-bf12-d388bfb0714c] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:13:15.066437 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-ed3b8c2b-6599-4f7b-86c1-a9b45d2685b7 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:15.066877 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-ed3b8c2b-6599-4f7b-86c1-a9b45d2685b7 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:15.067646 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-ed3b8c2b-6599-4f7b-86c1-a9b45d2685b7 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:15.068374 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-ed3b8c2b-6599-4f7b-86c1-a9b45d2685b7 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:15.092304 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-ed3b8c2b-6599-4f7b-86c1-a9b45d2685b7 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c/ips" status: 200 len: 152 microversion: 2.20 time: 0.040061 Jun 07 22:13:15.092869 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 595/1195] 10.222.0.13 () {60 vars in 1288 bytes} [Tue Jun 7 22:13:15 2022] GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c/ips => generated 152 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 22:13:16.935748 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_api:SELECT=41,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:13:16.936407 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_cell1:SELECT=67 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:13:16.940840 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-ec86b67d-8531-4f47-92c5-e6800b1d571a tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:13:16.941453 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-ec86b67d-8531-4f47-92c5-e6800b1d571a tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: cddfb0ad-63f6-4b0d-bf12-d388bfb0714c] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:13:16.949193 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ec86b67d-8531-4f47-92c5-e6800b1d571a tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:16.949640 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ec86b67d-8531-4f47-92c5-e6800b1d571a tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:16.950411 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ec86b67d-8531-4f47-92c5-e6800b1d571a tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:16.950847 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ec86b67d-8531-4f47-92c5-e6800b1d571a tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:16.974049 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.objects.instance [None req-ec86b67d-8531-4f47-92c5-e6800b1d571a tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lazy-loading 'flavor' on Instance uuid cddfb0ad-63f6-4b0d-bf12-d388bfb0714c {{(pid=117971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 22:13:17.428478 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-ec86b67d-8531-4f47-92c5-e6800b1d571a tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "POST /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c/action" status: 202 len: 0 microversion: 2.20 time: 0.494359 Jun 07 22:13:17.429103 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 601/1196] 10.222.0.13 () {62 vars in 1318 bytes} [Tue Jun 7 22:13:16 2022] POST /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c/action => generated 0 bytes in 496 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 07 22:13:17.437988 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-4e902254-e523-4c7f-8601-539c12ac6309 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:13:17.438609 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-4e902254-e523-4c7f-8601-539c12ac6309 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: cddfb0ad-63f6-4b0d-bf12-d388bfb0714c] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:13:17.445137 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4e902254-e523-4c7f-8601-539c12ac6309 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:17.445698 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4e902254-e523-4c7f-8601-539c12ac6309 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:17.446599 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4e902254-e523-4c7f-8601-539c12ac6309 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:17.447044 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4e902254-e523-4c7f-8601-539c12ac6309 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:17.677380 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-4e902254-e523-4c7f-8601-539c12ac6309 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:17.685821 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-4e902254-e523-4c7f-8601-539c12ac6309 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:17.687319 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-4e902254-e523-4c7f-8601-539c12ac6309 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:17.688503 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-4e902254-e523-4c7f-8601-539c12ac6309 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c" status: 200 len: 1723 microversion: 2.20 time: 0.254507 Jun 07 22:13:17.689064 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 596/1197] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:13:17 2022] GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c => generated 1723 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:13:18.708660 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-cbd83c0f-1c11-456a-9ada-2e12e3d1be93 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:13:18.709296 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-cbd83c0f-1c11-456a-9ada-2e12e3d1be93 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: cddfb0ad-63f6-4b0d-bf12-d388bfb0714c] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:13:18.716548 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-cbd83c0f-1c11-456a-9ada-2e12e3d1be93 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:18.716997 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-cbd83c0f-1c11-456a-9ada-2e12e3d1be93 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:18.717747 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-cbd83c0f-1c11-456a-9ada-2e12e3d1be93 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:18.718413 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-cbd83c0f-1c11-456a-9ada-2e12e3d1be93 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:18.859241 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-cbd83c0f-1c11-456a-9ada-2e12e3d1be93 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:18.867284 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-cbd83c0f-1c11-456a-9ada-2e12e3d1be93 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:18.869881 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-cbd83c0f-1c11-456a-9ada-2e12e3d1be93 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:18.871112 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-cbd83c0f-1c11-456a-9ada-2e12e3d1be93 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c" status: 200 len: 1723 microversion: 2.20 time: 0.167358 Jun 07 22:13:18.871614 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 602/1198] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:13:18 2022] GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:13:19.890160 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-57688fba-b63b-41cd-8d9f-e237839f8092 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:13:19.890764 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-57688fba-b63b-41cd-8d9f-e237839f8092 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: cddfb0ad-63f6-4b0d-bf12-d388bfb0714c] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:13:19.897237 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-57688fba-b63b-41cd-8d9f-e237839f8092 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:19.897677 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-57688fba-b63b-41cd-8d9f-e237839f8092 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:19.898420 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-57688fba-b63b-41cd-8d9f-e237839f8092 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:19.898847 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-57688fba-b63b-41cd-8d9f-e237839f8092 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:20.027787 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-57688fba-b63b-41cd-8d9f-e237839f8092 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:20.035569 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-57688fba-b63b-41cd-8d9f-e237839f8092 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:20.037053 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-57688fba-b63b-41cd-8d9f-e237839f8092 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:20.038201 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-57688fba-b63b-41cd-8d9f-e237839f8092 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c" status: 200 len: 1723 microversion: 2.20 time: 0.152833 Jun 07 22:13:20.038759 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 597/1199] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:13:19 2022] GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:13:21.056305 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-295da198-e234-4ff5-bbb7-83c7513998ab tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:13:21.056894 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-295da198-e234-4ff5-bbb7-83c7513998ab tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: cddfb0ad-63f6-4b0d-bf12-d388bfb0714c] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:13:21.064081 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-295da198-e234-4ff5-bbb7-83c7513998ab tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:21.064513 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-295da198-e234-4ff5-bbb7-83c7513998ab tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:21.065265 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-295da198-e234-4ff5-bbb7-83c7513998ab tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:21.066023 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-295da198-e234-4ff5-bbb7-83c7513998ab tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:21.121859 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-7ea1d1d6-7991-4186-b418-343af18bbff7 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1494278365", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1489617035", "security_groups": [{"name": "tempest-secgroup-smoke-1229564476"}], "block_device_mapping_v2": [{"uuid": "b7595cc7-03c0-486e-8fa9-e911aab5953c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "63aac617-2d3a-4d8b-b894-a27820a7e5e2"}]}} {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:13:21.205721 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-295da198-e234-4ff5-bbb7-83c7513998ab tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:21.215751 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-295da198-e234-4ff5-bbb7-83c7513998ab tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:21.217482 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-295da198-e234-4ff5-bbb7-83c7513998ab tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:21.218644 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-295da198-e234-4ff5-bbb7-83c7513998ab tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c" status: 200 len: 1723 microversion: 2.20 time: 0.166236 Jun 07 22:13:21.219194 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 603/1200] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:13:21 2022] GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:13:21.237165 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.network.neutron [None req-7ea1d1d6-7991-4186-b418-343af18bbff7 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] validate_networks() for [('63aac617-2d3a-4d8b-b894-a27820a7e5e2', None, None, None, None, None)] {{(pid=117970) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 22:13:21.613281 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.virt.hardware [None req-7ea1d1d6-7991-4186-b418-343af18bbff7 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Flavor limits 0:0:0 {{(pid=117970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 22:13:21.613694 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.virt.hardware [None req-7ea1d1d6-7991-4186-b418-343af18bbff7 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Image limits 0:0:0 {{(pid=117970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 22:13:21.614158 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.virt.hardware [None req-7ea1d1d6-7991-4186-b418-343af18bbff7 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Flavor pref 0:0:0 {{(pid=117970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 22:13:21.614557 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.virt.hardware [None req-7ea1d1d6-7991-4186-b418-343af18bbff7 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Image pref 0:0:0 {{(pid=117970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 22:13:21.614958 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.virt.hardware [None req-7ea1d1d6-7991-4186-b418-343af18bbff7 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 22:13:21.624318 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-7ea1d1d6-7991-4186-b418-343af18bbff7 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:21.624756 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-7ea1d1d6-7991-4186-b418-343af18bbff7 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:21.625536 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-7ea1d1d6-7991-4186-b418-343af18bbff7 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:21.625964 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-7ea1d1d6-7991-4186-b418-343af18bbff7 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:21.642037 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.quota [None req-7ea1d1d6-7991-4186-b418-343af18bbff7 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Getting quotas for project 579eb78d8af74e2cadce3a0c793b4440. Resources: {'cores', 'ram', 'instances'} {{(pid=117970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 22:13:21.645875 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.quota [None req-7ea1d1d6-7991-4186-b418-343af18bbff7 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Getting quotas for user c710942802df49ec8bd630e4b225eed2 and project 579eb78d8af74e2cadce3a0c793b4440. Resources: {'cores', 'ram', 'instances'} {{(pid=117970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 22:13:21.701664 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-7ea1d1d6-7991-4186-b418-343af18bbff7 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Going to run 1 instances... {{(pid=117970) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 22:13:21.703771 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-7ea1d1d6-7991-4186-b418-343af18bbff7 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: 396f0b5c-2d4c-486e-9ab6-b781fc612a4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b7595cc7-03c0-486e-8fa9-e911aab5953c',volume_size=None,volume_type=None)] {{(pid=117970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 22:13:21.828674 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-7ea1d1d6-7991-4186-b418-343af18bbff7 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.711041 Jun 07 22:13:21.829314 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 598/1201] 10.222.0.13 () {60 vars in 1146 bytes} [Tue Jun 7 22:13:21 2022] POST /compute/v2.1/servers => generated 406 bytes in 712 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 07 22:13:21.840919 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-180536d5-e2c3-4a59-820d-484bd14f7a15 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:13:21.841632 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-180536d5-e2c3-4a59-820d-484bd14f7a15 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: 396f0b5c-2d4c-486e-9ab6-b781fc612a4a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:13:21.897647 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-180536d5-e2c3-4a59-820d-484bd14f7a15 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:21.904458 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-180536d5-e2c3-4a59-820d-484bd14f7a15 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/396f0b5c-2d4c-486e-9ab6-b781fc612a4a" status: 200 len: 1095 microversion: 2.1 time: 0.068847 Jun 07 22:13:21.905023 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 604/1202] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:13:21 2022] GET /compute/v2.1/servers/396f0b5c-2d4c-486e-9ab6-b781fc612a4a => generated 1095 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:13:22.237647 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-fd4753b8-b07f-4fa9-b00a-fc5926d7e27d tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:13:22.238263 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-fd4753b8-b07f-4fa9-b00a-fc5926d7e27d tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: cddfb0ad-63f6-4b0d-bf12-d388bfb0714c] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:13:22.246103 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-fd4753b8-b07f-4fa9-b00a-fc5926d7e27d tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:22.246640 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-fd4753b8-b07f-4fa9-b00a-fc5926d7e27d tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:22.247782 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-fd4753b8-b07f-4fa9-b00a-fc5926d7e27d tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:22.248369 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-fd4753b8-b07f-4fa9-b00a-fc5926d7e27d tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:22.385744 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-fd4753b8-b07f-4fa9-b00a-fc5926d7e27d tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:22.394290 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-fd4753b8-b07f-4fa9-b00a-fc5926d7e27d tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:22.396047 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-fd4753b8-b07f-4fa9-b00a-fc5926d7e27d tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:22.397213 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-fd4753b8-b07f-4fa9-b00a-fc5926d7e27d tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c" status: 200 len: 1723 microversion: 2.20 time: 0.164782 Jun 07 22:13:22.397773 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 599/1203] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:13:22 2022] GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:13:22.923152 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-d8655e63-3f37-4f0e-bdff-1c160d448b04 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:13:22.924009 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-d8655e63-3f37-4f0e-bdff-1c160d448b04 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: 396f0b5c-2d4c-486e-9ab6-b781fc612a4a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:13:22.930716 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-d8655e63-3f37-4f0e-bdff-1c160d448b04 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:22.931157 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-d8655e63-3f37-4f0e-bdff-1c160d448b04 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:22.931939 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-d8655e63-3f37-4f0e-bdff-1c160d448b04 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:22.932372 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-d8655e63-3f37-4f0e-bdff-1c160d448b04 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:22.996988 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-d8655e63-3f37-4f0e-bdff-1c160d448b04 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:23.004491 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-d8655e63-3f37-4f0e-bdff-1c160d448b04 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/396f0b5c-2d4c-486e-9ab6-b781fc612a4a" status: 200 len: 1211 microversion: 2.1 time: 0.086442 Jun 07 22:13:23.005066 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 605/1204] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:13:22 2022] GET /compute/v2.1/servers/396f0b5c-2d4c-486e-9ab6-b781fc612a4a => generated 1211 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:13:23.415876 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-419015ba-cae4-4424-bb10-4e93baa5e7ef tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:13:23.416496 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-419015ba-cae4-4424-bb10-4e93baa5e7ef tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: cddfb0ad-63f6-4b0d-bf12-d388bfb0714c] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:13:23.423744 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-419015ba-cae4-4424-bb10-4e93baa5e7ef tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:23.424192 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-419015ba-cae4-4424-bb10-4e93baa5e7ef tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:23.424951 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-419015ba-cae4-4424-bb10-4e93baa5e7ef tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:23.425389 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-419015ba-cae4-4424-bb10-4e93baa5e7ef tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:23.658486 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-419015ba-cae4-4424-bb10-4e93baa5e7ef tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:23.668208 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-419015ba-cae4-4424-bb10-4e93baa5e7ef tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:23.670132 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-419015ba-cae4-4424-bb10-4e93baa5e7ef tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:23.672252 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-419015ba-cae4-4424-bb10-4e93baa5e7ef tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c" status: 200 len: 1723 microversion: 2.20 time: 0.260337 Jun 07 22:13:23.682627 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 600/1205] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:13:23 2022] GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c => generated 1723 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:13:24.021739 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-92195d1b-e754-4101-8bfb-d603222b99a8 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:13:24.022295 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-92195d1b-e754-4101-8bfb-d603222b99a8 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: 396f0b5c-2d4c-486e-9ab6-b781fc612a4a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:13:24.028915 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-92195d1b-e754-4101-8bfb-d603222b99a8 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:24.029402 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-92195d1b-e754-4101-8bfb-d603222b99a8 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:24.030255 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-92195d1b-e754-4101-8bfb-d603222b99a8 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:24.030700 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-92195d1b-e754-4101-8bfb-d603222b99a8 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:24.165938 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-92195d1b-e754-4101-8bfb-d603222b99a8 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:24.174780 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-92195d1b-e754-4101-8bfb-d603222b99a8 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/396f0b5c-2d4c-486e-9ab6-b781fc612a4a" status: 200 len: 1267 microversion: 2.1 time: 0.156983 Jun 07 22:13:24.175371 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 606/1206] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:13:24 2022] GET /compute/v2.1/servers/396f0b5c-2d4c-486e-9ab6-b781fc612a4a => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:13:24.452589 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [req-dd2449e8-1eeb-4012-9e09-d9da36aeab4c req-45343198-47ca-46dc-9a22-acd80bb95452 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "396f0b5c-2d4c-486e-9ab6-b781fc612a4a", "tag": "5b7c7edd-c543-41ae-bf73-9c85442dfb14"}]} {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:13:24.463180 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [req-dd2449e8-1eeb-4012-9e09-d9da36aeab4c req-45343198-47ca-46dc-9a22-acd80bb95452 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:24.469492 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [req-dd2449e8-1eeb-4012-9e09-d9da36aeab4c req-45343198-47ca-46dc-9a22-acd80bb95452 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:24.484628 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.compute.server_external_events [req-dd2449e8-1eeb-4012-9e09-d9da36aeab4c req-45343198-47ca-46dc-9a22-acd80bb95452 service nova] Creating event network-changed:5b7c7edd-c543-41ae-bf73-9c85442dfb14 for instance 396f0b5c-2d4c-486e-9ab6-b781fc612a4a on hv-cinder-83552 Jun 07 22:13:24.490337 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [req-dd2449e8-1eeb-4012-9e09-d9da36aeab4c req-45343198-47ca-46dc-9a22-acd80bb95452 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043397 Jun 07 22:13:24.491261 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 601/1207] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:13:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 22:13:24.691063 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-2cce66c4-1fd4-4cc2-82db-bad50e840702 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:13:24.692016 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-2cce66c4-1fd4-4cc2-82db-bad50e840702 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: cddfb0ad-63f6-4b0d-bf12-d388bfb0714c] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:13:24.698100 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-2cce66c4-1fd4-4cc2-82db-bad50e840702 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:24.698549 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-2cce66c4-1fd4-4cc2-82db-bad50e840702 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:24.699385 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-2cce66c4-1fd4-4cc2-82db-bad50e840702 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:24.699776 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-2cce66c4-1fd4-4cc2-82db-bad50e840702 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:24.828712 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-2cce66c4-1fd4-4cc2-82db-bad50e840702 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:24.836636 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-2cce66c4-1fd4-4cc2-82db-bad50e840702 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:24.838126 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-2cce66c4-1fd4-4cc2-82db-bad50e840702 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:24.839281 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-2cce66c4-1fd4-4cc2-82db-bad50e840702 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c" status: 200 len: 1723 microversion: 2.20 time: 0.152532 Jun 07 22:13:24.839863 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 607/1208] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:13:24 2022] GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:13:25.193342 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-c6a65171-4a24-408e-8605-b2039d34df80 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:13:25.194030 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-c6a65171-4a24-408e-8605-b2039d34df80 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: 396f0b5c-2d4c-486e-9ab6-b781fc612a4a] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:13:25.200282 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c6a65171-4a24-408e-8605-b2039d34df80 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:25.200726 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c6a65171-4a24-408e-8605-b2039d34df80 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:25.203453 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c6a65171-4a24-408e-8605-b2039d34df80 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:25.204263 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c6a65171-4a24-408e-8605-b2039d34df80 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:25.337140 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-c6a65171-4a24-408e-8605-b2039d34df80 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:25.344563 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-c6a65171-4a24-408e-8605-b2039d34df80 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/396f0b5c-2d4c-486e-9ab6-b781fc612a4a" status: 200 len: 1267 microversion: 2.1 time: 0.155410 Jun 07 22:13:25.345125 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 602/1209] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:13:25 2022] GET /compute/v2.1/servers/396f0b5c-2d4c-486e-9ab6-b781fc612a4a => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:13:25.858981 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-dbb72f27-17fa-4e4c-9721-c0da7d3931a5 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:13:25.859611 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-dbb72f27-17fa-4e4c-9721-c0da7d3931a5 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: cddfb0ad-63f6-4b0d-bf12-d388bfb0714c] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:13:25.866068 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-dbb72f27-17fa-4e4c-9721-c0da7d3931a5 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:25.866514 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-dbb72f27-17fa-4e4c-9721-c0da7d3931a5 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:25.867266 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-dbb72f27-17fa-4e4c-9721-c0da7d3931a5 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:25.867724 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-dbb72f27-17fa-4e4c-9721-c0da7d3931a5 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:25.995568 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-dbb72f27-17fa-4e4c-9721-c0da7d3931a5 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:26.003610 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-dbb72f27-17fa-4e4c-9721-c0da7d3931a5 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:26.005103 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-dbb72f27-17fa-4e4c-9721-c0da7d3931a5 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:26.006253 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-dbb72f27-17fa-4e4c-9721-c0da7d3931a5 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c" status: 200 len: 1723 microversion: 2.20 time: 0.152072 Jun 07 22:13:26.006808 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 608/1210] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:13:25 2022] GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:13:26.362300 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-6f81aade-8fa5-4493-9b7e-6e98fc432233 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:13:26.363003 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-6f81aade-8fa5-4493-9b7e-6e98fc432233 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: 396f0b5c-2d4c-486e-9ab6-b781fc612a4a] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:13:26.369354 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6f81aade-8fa5-4493-9b7e-6e98fc432233 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:26.369800 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6f81aade-8fa5-4493-9b7e-6e98fc432233 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:26.370561 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6f81aade-8fa5-4493-9b7e-6e98fc432233 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:26.370983 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6f81aade-8fa5-4493-9b7e-6e98fc432233 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:26.610955 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-6f81aade-8fa5-4493-9b7e-6e98fc432233 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:26.618340 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-6f81aade-8fa5-4493-9b7e-6e98fc432233 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/396f0b5c-2d4c-486e-9ab6-b781fc612a4a" status: 200 len: 1267 microversion: 2.1 time: 0.260703 Jun 07 22:13:26.618896 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 603/1211] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:13:26 2022] GET /compute/v2.1/servers/396f0b5c-2d4c-486e-9ab6-b781fc612a4a => generated 1267 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:13:27.024428 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-bec8366c-0977-4629-a6c6-adafc49f8b25 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:13:27.024954 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-bec8366c-0977-4629-a6c6-adafc49f8b25 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: cddfb0ad-63f6-4b0d-bf12-d388bfb0714c] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:13:27.031830 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-bec8366c-0977-4629-a6c6-adafc49f8b25 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:27.032277 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-bec8366c-0977-4629-a6c6-adafc49f8b25 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:27.033031 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-bec8366c-0977-4629-a6c6-adafc49f8b25 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:27.033466 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-bec8366c-0977-4629-a6c6-adafc49f8b25 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:27.164288 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-bec8366c-0977-4629-a6c6-adafc49f8b25 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:27.175719 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-bec8366c-0977-4629-a6c6-adafc49f8b25 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:27.178206 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-bec8366c-0977-4629-a6c6-adafc49f8b25 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:27.180035 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-bec8366c-0977-4629-a6c6-adafc49f8b25 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c" status: 200 len: 1723 microversion: 2.20 time: 0.159386 Jun 07 22:13:27.181022 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 609/1212] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:13:27 2022] GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:13:27.635690 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-8a2a4f8c-bde8-472a-b7f7-f3f77b48b089 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:13:27.636290 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-8a2a4f8c-bde8-472a-b7f7-f3f77b48b089 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: 396f0b5c-2d4c-486e-9ab6-b781fc612a4a] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:13:27.642676 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-8a2a4f8c-bde8-472a-b7f7-f3f77b48b089 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:27.643117 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-8a2a4f8c-bde8-472a-b7f7-f3f77b48b089 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:27.643892 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-8a2a4f8c-bde8-472a-b7f7-f3f77b48b089 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:27.644318 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-8a2a4f8c-bde8-472a-b7f7-f3f77b48b089 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:27.774182 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-8a2a4f8c-bde8-472a-b7f7-f3f77b48b089 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:27.782050 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-8a2a4f8c-bde8-472a-b7f7-f3f77b48b089 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/396f0b5c-2d4c-486e-9ab6-b781fc612a4a" status: 200 len: 1267 microversion: 2.1 time: 0.150290 Jun 07 22:13:27.782611 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 604/1213] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:13:27 2022] GET /compute/v2.1/servers/396f0b5c-2d4c-486e-9ab6-b781fc612a4a => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:13:28.198538 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-db6d43c1-6248-404c-82e6-0d650135ed04 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:13:28.199147 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-db6d43c1-6248-404c-82e6-0d650135ed04 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: cddfb0ad-63f6-4b0d-bf12-d388bfb0714c] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:13:28.206149 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-db6d43c1-6248-404c-82e6-0d650135ed04 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:28.206596 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-db6d43c1-6248-404c-82e6-0d650135ed04 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:28.207360 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-db6d43c1-6248-404c-82e6-0d650135ed04 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:28.207799 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-db6d43c1-6248-404c-82e6-0d650135ed04 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:28.334879 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-db6d43c1-6248-404c-82e6-0d650135ed04 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:28.342717 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-db6d43c1-6248-404c-82e6-0d650135ed04 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:28.344258 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-db6d43c1-6248-404c-82e6-0d650135ed04 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:28.345420 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-db6d43c1-6248-404c-82e6-0d650135ed04 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c" status: 200 len: 1723 microversion: 2.20 time: 0.150776 Jun 07 22:13:28.345981 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 610/1214] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:13:28 2022] GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:13:28.799546 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-67b41736-0d03-4bb2-8e1b-f3160a07dfe8 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:13:28.800155 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-67b41736-0d03-4bb2-8e1b-f3160a07dfe8 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: 396f0b5c-2d4c-486e-9ab6-b781fc612a4a] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:13:28.806519 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-67b41736-0d03-4bb2-8e1b-f3160a07dfe8 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:28.806960 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-67b41736-0d03-4bb2-8e1b-f3160a07dfe8 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:28.807735 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-67b41736-0d03-4bb2-8e1b-f3160a07dfe8 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:28.808163 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-67b41736-0d03-4bb2-8e1b-f3160a07dfe8 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:28.935057 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-67b41736-0d03-4bb2-8e1b-f3160a07dfe8 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:28.943124 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-67b41736-0d03-4bb2-8e1b-f3160a07dfe8 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/396f0b5c-2d4c-486e-9ab6-b781fc612a4a" status: 200 len: 1267 microversion: 2.1 time: 0.148019 Jun 07 22:13:28.943722 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 605/1215] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:13:28 2022] GET /compute/v2.1/servers/396f0b5c-2d4c-486e-9ab6-b781fc612a4a => generated 1267 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:13:29.363913 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-dfb04de9-b5c4-4d46-81eb-99d5b1ffd539 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:13:29.364605 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-dfb04de9-b5c4-4d46-81eb-99d5b1ffd539 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: cddfb0ad-63f6-4b0d-bf12-d388bfb0714c] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:13:29.373056 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-dfb04de9-b5c4-4d46-81eb-99d5b1ffd539 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:29.373826 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-dfb04de9-b5c4-4d46-81eb-99d5b1ffd539 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:29.374922 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-dfb04de9-b5c4-4d46-81eb-99d5b1ffd539 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:29.375419 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-dfb04de9-b5c4-4d46-81eb-99d5b1ffd539 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:29.505772 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-dfb04de9-b5c4-4d46-81eb-99d5b1ffd539 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:29.513671 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-dfb04de9-b5c4-4d46-81eb-99d5b1ffd539 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:29.515744 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-dfb04de9-b5c4-4d46-81eb-99d5b1ffd539 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:29.516908 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-dfb04de9-b5c4-4d46-81eb-99d5b1ffd539 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c" status: 200 len: 1744 microversion: 2.20 time: 0.157021 Jun 07 22:13:29.517467 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 611/1216] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:13:29 2022] GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c => generated 1744 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:13:29.962169 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-1507282b-56a4-4c9d-82cd-e9cd05079216 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:13:29.962771 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-1507282b-56a4-4c9d-82cd-e9cd05079216 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: 396f0b5c-2d4c-486e-9ab6-b781fc612a4a] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:13:29.970018 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1507282b-56a4-4c9d-82cd-e9cd05079216 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:29.970458 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1507282b-56a4-4c9d-82cd-e9cd05079216 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:29.971199 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1507282b-56a4-4c9d-82cd-e9cd05079216 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:29.971668 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1507282b-56a4-4c9d-82cd-e9cd05079216 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:30.103570 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-1507282b-56a4-4c9d-82cd-e9cd05079216 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:30.111659 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-1507282b-56a4-4c9d-82cd-e9cd05079216 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/396f0b5c-2d4c-486e-9ab6-b781fc612a4a" status: 200 len: 1267 microversion: 2.1 time: 0.153273 Jun 07 22:13:30.112213 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 606/1217] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:13:29 2022] GET /compute/v2.1/servers/396f0b5c-2d4c-486e-9ab6-b781fc612a4a => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:13:30.536043 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-d25e29ed-1e84-44ab-8582-8aecb6ec9a43 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:13:30.536651 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-d25e29ed-1e84-44ab-8582-8aecb6ec9a43 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: cddfb0ad-63f6-4b0d-bf12-d388bfb0714c] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:13:30.543106 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-d25e29ed-1e84-44ab-8582-8aecb6ec9a43 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:30.543582 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-d25e29ed-1e84-44ab-8582-8aecb6ec9a43 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:30.544353 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-d25e29ed-1e84-44ab-8582-8aecb6ec9a43 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:30.544787 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-d25e29ed-1e84-44ab-8582-8aecb6ec9a43 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:30.670126 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-d25e29ed-1e84-44ab-8582-8aecb6ec9a43 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:30.678540 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-d25e29ed-1e84-44ab-8582-8aecb6ec9a43 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:30.680206 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-d25e29ed-1e84-44ab-8582-8aecb6ec9a43 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:30.681348 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-d25e29ed-1e84-44ab-8582-8aecb6ec9a43 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c" status: 200 len: 1744 microversion: 2.20 time: 0.149277 Jun 07 22:13:30.681901 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 612/1218] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:13:30 2022] GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c => generated 1744 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:13:31.127738 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-f8ea5a15-565e-4326-9506-749492a788c6 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:13:31.128339 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-f8ea5a15-565e-4326-9506-749492a788c6 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: 396f0b5c-2d4c-486e-9ab6-b781fc612a4a] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:13:31.134716 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f8ea5a15-565e-4326-9506-749492a788c6 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:31.135153 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f8ea5a15-565e-4326-9506-749492a788c6 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:31.135930 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f8ea5a15-565e-4326-9506-749492a788c6 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:31.136359 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f8ea5a15-565e-4326-9506-749492a788c6 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:31.265575 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-f8ea5a15-565e-4326-9506-749492a788c6 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:31.272997 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-f8ea5a15-565e-4326-9506-749492a788c6 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/396f0b5c-2d4c-486e-9ab6-b781fc612a4a" status: 200 len: 1267 microversion: 2.1 time: 0.149373 Jun 07 22:13:31.273561 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 607/1219] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:13:31 2022] GET /compute/v2.1/servers/396f0b5c-2d4c-486e-9ab6-b781fc612a4a => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:13:31.698425 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-378aafc6-c448-470c-a01d-35c2555fecb8 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:13:31.699028 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-378aafc6-c448-470c-a01d-35c2555fecb8 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: cddfb0ad-63f6-4b0d-bf12-d388bfb0714c] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:13:31.705624 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-378aafc6-c448-470c-a01d-35c2555fecb8 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:31.706069 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-378aafc6-c448-470c-a01d-35c2555fecb8 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:31.706817 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-378aafc6-c448-470c-a01d-35c2555fecb8 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:31.707249 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-378aafc6-c448-470c-a01d-35c2555fecb8 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:31.839000 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-378aafc6-c448-470c-a01d-35c2555fecb8 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:31.848759 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-378aafc6-c448-470c-a01d-35c2555fecb8 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:31.850245 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-378aafc6-c448-470c-a01d-35c2555fecb8 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:31.851441 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-378aafc6-c448-470c-a01d-35c2555fecb8 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c" status: 200 len: 1744 microversion: 2.20 time: 0.156921 Jun 07 22:13:31.852008 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 613/1220] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:13:31 2022] GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c => generated 1744 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:13:32.289893 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-95073803-53a8-4699-863a-dee997dee35a tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:13:32.290498 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-95073803-53a8-4699-863a-dee997dee35a tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: 396f0b5c-2d4c-486e-9ab6-b781fc612a4a] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:13:32.292481 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_cell0:SELECT=2 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:13:32.293264 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_cell0:SELECT=6 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:13:32.300937 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-95073803-53a8-4699-863a-dee997dee35a tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:32.301378 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-95073803-53a8-4699-863a-dee997dee35a tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:32.302123 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-95073803-53a8-4699-863a-dee997dee35a tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:32.302548 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-95073803-53a8-4699-863a-dee997dee35a tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:32.436371 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-95073803-53a8-4699-863a-dee997dee35a tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:32.444476 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-95073803-53a8-4699-863a-dee997dee35a tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/396f0b5c-2d4c-486e-9ab6-b781fc612a4a" status: 200 len: 1267 microversion: 2.1 time: 0.158436 Jun 07 22:13:32.445050 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 608/1221] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:13:32 2022] GET /compute/v2.1/servers/396f0b5c-2d4c-486e-9ab6-b781fc612a4a => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:13:32.872193 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-831d62fa-5f3f-4176-8ae1-f4abd31affcb tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:13:32.872717 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-831d62fa-5f3f-4176-8ae1-f4abd31affcb tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: cddfb0ad-63f6-4b0d-bf12-d388bfb0714c] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:13:32.874742 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_cell0:SELECT=2 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:13:32.880432 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-831d62fa-5f3f-4176-8ae1-f4abd31affcb tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:32.880950 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-831d62fa-5f3f-4176-8ae1-f4abd31affcb tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:32.881703 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-831d62fa-5f3f-4176-8ae1-f4abd31affcb tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:32.882137 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-831d62fa-5f3f-4176-8ae1-f4abd31affcb tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:33.009010 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-831d62fa-5f3f-4176-8ae1-f4abd31affcb tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:33.017220 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-831d62fa-5f3f-4176-8ae1-f4abd31affcb tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:33.018695 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-831d62fa-5f3f-4176-8ae1-f4abd31affcb tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:33.019876 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-831d62fa-5f3f-4176-8ae1-f4abd31affcb tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c" status: 200 len: 1744 microversion: 2.20 time: 0.151717 Jun 07 22:13:33.020425 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 614/1222] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:13:32 2022] GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c => generated 1744 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:13:33.461273 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-86d9fece-0259-4a3d-b41a-d0d35d17ccfd tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:13:33.461793 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-86d9fece-0259-4a3d-b41a-d0d35d17ccfd tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: 396f0b5c-2d4c-486e-9ab6-b781fc612a4a] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:13:33.468817 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-86d9fece-0259-4a3d-b41a-d0d35d17ccfd tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:33.469413 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-86d9fece-0259-4a3d-b41a-d0d35d17ccfd tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:33.470155 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-86d9fece-0259-4a3d-b41a-d0d35d17ccfd tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:33.470584 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-86d9fece-0259-4a3d-b41a-d0d35d17ccfd tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:33.597674 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-86d9fece-0259-4a3d-b41a-d0d35d17ccfd tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:33.605597 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-86d9fece-0259-4a3d-b41a-d0d35d17ccfd tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/396f0b5c-2d4c-486e-9ab6-b781fc612a4a" status: 200 len: 1267 microversion: 2.1 time: 0.148269 Jun 07 22:13:33.606159 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 609/1223] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:13:33 2022] GET /compute/v2.1/servers/396f0b5c-2d4c-486e-9ab6-b781fc612a4a => generated 1267 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:13:34.037640 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-38de43ba-7563-41aa-81a8-d0b7c8a9ae16 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:13:34.038242 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-38de43ba-7563-41aa-81a8-d0b7c8a9ae16 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: cddfb0ad-63f6-4b0d-bf12-d388bfb0714c] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:13:34.044737 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-38de43ba-7563-41aa-81a8-d0b7c8a9ae16 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:34.045176 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-38de43ba-7563-41aa-81a8-d0b7c8a9ae16 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:34.045918 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-38de43ba-7563-41aa-81a8-d0b7c8a9ae16 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:34.046993 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-38de43ba-7563-41aa-81a8-d0b7c8a9ae16 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:34.176580 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-38de43ba-7563-41aa-81a8-d0b7c8a9ae16 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:34.184374 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-38de43ba-7563-41aa-81a8-d0b7c8a9ae16 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:34.185863 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-38de43ba-7563-41aa-81a8-d0b7c8a9ae16 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:34.187634 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-38de43ba-7563-41aa-81a8-d0b7c8a9ae16 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c" status: 200 len: 1744 microversion: 2.20 time: 0.153184 Jun 07 22:13:34.188384 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 615/1224] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:13:34 2022] GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c => generated 1744 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:13:34.622542 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-aa962e3d-98bc-4862-92b0-7e38985680b3 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:13:34.623162 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-aa962e3d-98bc-4862-92b0-7e38985680b3 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: 396f0b5c-2d4c-486e-9ab6-b781fc612a4a] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:13:34.630031 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-aa962e3d-98bc-4862-92b0-7e38985680b3 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:34.630475 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-aa962e3d-98bc-4862-92b0-7e38985680b3 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:34.631314 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-aa962e3d-98bc-4862-92b0-7e38985680b3 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:34.631751 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-aa962e3d-98bc-4862-92b0-7e38985680b3 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:34.636935 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [req-9b81e53a-e610-49ae-b9f3-9e3b96380285 req-711db860-5921-4e4a-bf28-515e4b1cab3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cddfb0ad-63f6-4b0d-bf12-d388bfb0714c", "name": "network-vif-plugged", "status": "completed", "tag": "e1237eb4-3f3b-48bf-97bb-9e2c3cfc48b3"}]} {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:13:34.645888 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-9b81e53a-e610-49ae-b9f3-9e3b96380285 req-711db860-5921-4e4a-bf28-515e4b1cab3d service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:34.646473 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-9b81e53a-e610-49ae-b9f3-9e3b96380285 req-711db860-5921-4e4a-bf28-515e4b1cab3d service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:34.660846 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.compute.server_external_events [req-9b81e53a-e610-49ae-b9f3-9e3b96380285 req-711db860-5921-4e4a-bf28-515e4b1cab3d service nova] Creating event network-vif-plugged:e1237eb4-3f3b-48bf-97bb-9e2c3cfc48b3 for instance cddfb0ad-63f6-4b0d-bf12-d388bfb0714c on hv-cinder-83552 Jun 07 22:13:34.666108 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [req-9b81e53a-e610-49ae-b9f3-9e3b96380285 req-711db860-5921-4e4a-bf28-515e4b1cab3d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033174 Jun 07 22:13:34.666998 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 616/1225] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:13:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:13:34.772880 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-aa962e3d-98bc-4862-92b0-7e38985680b3 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:34.780354 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-aa962e3d-98bc-4862-92b0-7e38985680b3 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/396f0b5c-2d4c-486e-9ab6-b781fc612a4a" status: 200 len: 1267 microversion: 2.1 time: 0.162212 Jun 07 22:13:34.781486 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 610/1226] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:13:34 2022] GET /compute/v2.1/servers/396f0b5c-2d4c-486e-9ab6-b781fc612a4a => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:13:35.207698 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-67d80ba5-de0a-4f86-bc28-a37a0042c961 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:13:35.208419 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-67d80ba5-de0a-4f86-bc28-a37a0042c961 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: cddfb0ad-63f6-4b0d-bf12-d388bfb0714c] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:13:35.215148 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-67d80ba5-de0a-4f86-bc28-a37a0042c961 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:35.215531 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-67d80ba5-de0a-4f86-bc28-a37a0042c961 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:35.216290 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-67d80ba5-de0a-4f86-bc28-a37a0042c961 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:35.216723 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-67d80ba5-de0a-4f86-bc28-a37a0042c961 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:35.221347 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:13:35.355307 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-67d80ba5-de0a-4f86-bc28-a37a0042c961 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:35.363956 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-67d80ba5-de0a-4f86-bc28-a37a0042c961 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:35.365474 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-67d80ba5-de0a-4f86-bc28-a37a0042c961 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:35.366633 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-67d80ba5-de0a-4f86-bc28-a37a0042c961 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c" status: 200 len: 1744 microversion: 2.20 time: 0.164276 Jun 07 22:13:35.367192 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 617/1227] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:13:35 2022] GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c => generated 1744 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:13:35.797733 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-d3e5fcfc-9751-4793-9471-044880c1057a tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:13:35.798332 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-d3e5fcfc-9751-4793-9471-044880c1057a tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: 396f0b5c-2d4c-486e-9ab6-b781fc612a4a] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:13:35.804796 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d3e5fcfc-9751-4793-9471-044880c1057a tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:35.805239 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d3e5fcfc-9751-4793-9471-044880c1057a tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:35.805981 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d3e5fcfc-9751-4793-9471-044880c1057a tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:35.806412 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d3e5fcfc-9751-4793-9471-044880c1057a tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:35.936152 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-d3e5fcfc-9751-4793-9471-044880c1057a tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:35.943595 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-d3e5fcfc-9751-4793-9471-044880c1057a tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/396f0b5c-2d4c-486e-9ab6-b781fc612a4a" status: 200 len: 1267 microversion: 2.1 time: 0.150586 Jun 07 22:13:35.944158 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 611/1228] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:13:35 2022] GET /compute/v2.1/servers/396f0b5c-2d4c-486e-9ab6-b781fc612a4a => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:13:36.385627 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-4453be5b-49ab-4552-ad76-d7a58ac60c86 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:13:36.386328 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-4453be5b-49ab-4552-ad76-d7a58ac60c86 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: cddfb0ad-63f6-4b0d-bf12-d388bfb0714c] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:13:36.394110 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-4453be5b-49ab-4552-ad76-d7a58ac60c86 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:36.394550 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-4453be5b-49ab-4552-ad76-d7a58ac60c86 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:36.395303 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-4453be5b-49ab-4552-ad76-d7a58ac60c86 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:36.395753 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-4453be5b-49ab-4552-ad76-d7a58ac60c86 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:36.520907 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-4453be5b-49ab-4552-ad76-d7a58ac60c86 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:36.528732 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-4453be5b-49ab-4552-ad76-d7a58ac60c86 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:36.530214 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-4453be5b-49ab-4552-ad76-d7a58ac60c86 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:36.531967 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-4453be5b-49ab-4552-ad76-d7a58ac60c86 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c" status: 200 len: 1744 microversion: 2.20 time: 0.150653 Jun 07 22:13:36.532766 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 618/1229] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:13:36 2022] GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c => generated 1744 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:13:36.885350 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [req-8c303459-c05d-45bd-9a6c-ee7f3eae4258 req-e76ab5db-bdd1-4558-930f-58e6cd6c4d6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "396f0b5c-2d4c-486e-9ab6-b781fc612a4a", "name": "network-vif-plugged", "status": "completed", "tag": "5b7c7edd-c543-41ae-bf73-9c85442dfb14"}]} {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:13:36.894415 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [req-8c303459-c05d-45bd-9a6c-ee7f3eae4258 req-e76ab5db-bdd1-4558-930f-58e6cd6c4d6c service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:36.894905 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [req-8c303459-c05d-45bd-9a6c-ee7f3eae4258 req-e76ab5db-bdd1-4558-930f-58e6cd6c4d6c service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:36.912823 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.compute.server_external_events [req-8c303459-c05d-45bd-9a6c-ee7f3eae4258 req-e76ab5db-bdd1-4558-930f-58e6cd6c4d6c service nova] Creating event network-vif-plugged:5b7c7edd-c543-41ae-bf73-9c85442dfb14 for instance 396f0b5c-2d4c-486e-9ab6-b781fc612a4a on hv-cinder-83552 Jun 07 22:13:36.918463 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [req-8c303459-c05d-45bd-9a6c-ee7f3eae4258 req-e76ab5db-bdd1-4558-930f-58e6cd6c4d6c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036875 Jun 07 22:13:36.919017 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 612/1230] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:13:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:13:36.961799 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-fea20f5b-792e-4526-96f1-8f93be26fafe tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:13:36.962617 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-fea20f5b-792e-4526-96f1-8f93be26fafe tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: 396f0b5c-2d4c-486e-9ab6-b781fc612a4a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:13:36.969099 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-fea20f5b-792e-4526-96f1-8f93be26fafe tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:36.969843 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-fea20f5b-792e-4526-96f1-8f93be26fafe tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:36.970764 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-fea20f5b-792e-4526-96f1-8f93be26fafe tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:36.971374 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-fea20f5b-792e-4526-96f1-8f93be26fafe tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:37.122817 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-fea20f5b-792e-4526-96f1-8f93be26fafe tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:37.133070 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-fea20f5b-792e-4526-96f1-8f93be26fafe tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/396f0b5c-2d4c-486e-9ab6-b781fc612a4a" status: 200 len: 1267 microversion: 2.1 time: 0.176451 Jun 07 22:13:37.133932 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 619/1231] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:13:36 2022] GET /compute/v2.1/servers/396f0b5c-2d4c-486e-9ab6-b781fc612a4a => generated 1267 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:13:37.551958 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-f2e65678-3334-4872-b213-6400f1dd5c7f tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:13:37.552646 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-f2e65678-3334-4872-b213-6400f1dd5c7f tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: cddfb0ad-63f6-4b0d-bf12-d388bfb0714c] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:13:37.562246 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f2e65678-3334-4872-b213-6400f1dd5c7f tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:37.564608 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f2e65678-3334-4872-b213-6400f1dd5c7f tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:37.565383 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f2e65678-3334-4872-b213-6400f1dd5c7f tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:37.565820 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f2e65678-3334-4872-b213-6400f1dd5c7f tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:37.763817 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-f2e65678-3334-4872-b213-6400f1dd5c7f tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:37.767959 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_cell1:SELECT=100 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:13:37.775211 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-f2e65678-3334-4872-b213-6400f1dd5c7f tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:37.777082 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-f2e65678-3334-4872-b213-6400f1dd5c7f tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:37.778680 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-f2e65678-3334-4872-b213-6400f1dd5c7f tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c" status: 200 len: 1739 microversion: 2.20 time: 0.230972 Jun 07 22:13:37.779865 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 613/1232] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:13:37 2022] GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c => generated 1739 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:13:38.151544 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-ed97a608-f547-4b5b-b344-65fb6deffec8 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:13:38.153428 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-ed97a608-f547-4b5b-b344-65fb6deffec8 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: 396f0b5c-2d4c-486e-9ab6-b781fc612a4a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:13:38.162496 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ed97a608-f547-4b5b-b344-65fb6deffec8 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:38.163218 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ed97a608-f547-4b5b-b344-65fb6deffec8 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:38.164316 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ed97a608-f547-4b5b-b344-65fb6deffec8 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:38.165239 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ed97a608-f547-4b5b-b344-65fb6deffec8 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:38.327852 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-ed97a608-f547-4b5b-b344-65fb6deffec8 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:38.335702 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-ed97a608-f547-4b5b-b344-65fb6deffec8 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/396f0b5c-2d4c-486e-9ab6-b781fc612a4a" status: 200 len: 1267 microversion: 2.1 time: 0.188312 Jun 07 22:13:38.346275 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 620/1233] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:13:38 2022] GET /compute/v2.1/servers/396f0b5c-2d4c-486e-9ab6-b781fc612a4a => generated 1267 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:13:38.799364 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-74a9ea79-7126-4599-a85e-61d306914205 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:13:38.800666 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-74a9ea79-7126-4599-a85e-61d306914205 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: cddfb0ad-63f6-4b0d-bf12-d388bfb0714c] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:13:38.813422 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-74a9ea79-7126-4599-a85e-61d306914205 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:38.814296 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-74a9ea79-7126-4599-a85e-61d306914205 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:38.815421 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-74a9ea79-7126-4599-a85e-61d306914205 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:38.815991 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-74a9ea79-7126-4599-a85e-61d306914205 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:38.979091 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-74a9ea79-7126-4599-a85e-61d306914205 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:38.990431 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-74a9ea79-7126-4599-a85e-61d306914205 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:38.991984 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-74a9ea79-7126-4599-a85e-61d306914205 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:38.993175 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-74a9ea79-7126-4599-a85e-61d306914205 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c" status: 200 len: 1739 microversion: 2.20 time: 0.199286 Jun 07 22:13:38.993734 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 614/1234] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:13:38 2022] GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c => generated 1739 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:13:39.355445 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-39cb46fc-6c54-463f-b3f6-a5d287d0ad63 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:13:39.356064 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-39cb46fc-6c54-463f-b3f6-a5d287d0ad63 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: 396f0b5c-2d4c-486e-9ab6-b781fc612a4a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:13:39.367180 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-39cb46fc-6c54-463f-b3f6-a5d287d0ad63 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:39.367881 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-39cb46fc-6c54-463f-b3f6-a5d287d0ad63 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:39.368826 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-39cb46fc-6c54-463f-b3f6-a5d287d0ad63 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:39.369447 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-39cb46fc-6c54-463f-b3f6-a5d287d0ad63 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:39.521619 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-39cb46fc-6c54-463f-b3f6-a5d287d0ad63 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:39.529807 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-39cb46fc-6c54-463f-b3f6-a5d287d0ad63 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/396f0b5c-2d4c-486e-9ab6-b781fc612a4a" status: 200 len: 1455 microversion: 2.1 time: 0.179593 Jun 07 22:13:39.530504 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 621/1235] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:13:39 2022] GET /compute/v2.1/servers/396f0b5c-2d4c-486e-9ab6-b781fc612a4a => generated 1455 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:13:39.546820 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-6c6dc92c-6125-40b5-9443-dc364adc4b02 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:13:39.547469 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-6c6dc92c-6125-40b5-9443-dc364adc4b02 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: 396f0b5c-2d4c-486e-9ab6-b781fc612a4a] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:13:39.554282 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6c6dc92c-6125-40b5-9443-dc364adc4b02 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:39.554732 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6c6dc92c-6125-40b5-9443-dc364adc4b02 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:39.555556 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6c6dc92c-6125-40b5-9443-dc364adc4b02 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:39.555994 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6c6dc92c-6125-40b5-9443-dc364adc4b02 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:39.701462 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-6c6dc92c-6125-40b5-9443-dc364adc4b02 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:39.709693 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-6c6dc92c-6125-40b5-9443-dc364adc4b02 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/396f0b5c-2d4c-486e-9ab6-b781fc612a4a" status: 200 len: 1455 microversion: 2.1 time: 0.166937 Jun 07 22:13:39.710459 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 615/1236] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:13:39 2022] GET /compute/v2.1/servers/396f0b5c-2d4c-486e-9ab6-b781fc612a4a => generated 1455 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:13:40.013722 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-df19b5fd-43aa-4de8-969c-c23919135e98 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:13:40.014333 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-df19b5fd-43aa-4de8-969c-c23919135e98 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: cddfb0ad-63f6-4b0d-bf12-d388bfb0714c] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:13:40.020904 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-df19b5fd-43aa-4de8-969c-c23919135e98 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:40.021907 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-df19b5fd-43aa-4de8-969c-c23919135e98 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:40.022132 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-df19b5fd-43aa-4de8-969c-c23919135e98 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:40.022569 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-df19b5fd-43aa-4de8-969c-c23919135e98 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:40.170128 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-df19b5fd-43aa-4de8-969c-c23919135e98 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:40.188323 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-df19b5fd-43aa-4de8-969c-c23919135e98 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:40.189950 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-df19b5fd-43aa-4de8-969c-c23919135e98 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:40.191303 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-df19b5fd-43aa-4de8-969c-c23919135e98 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c" status: 200 len: 1739 microversion: 2.20 time: 0.181651 Jun 07 22:13:40.192068 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 622/1237] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:13:40 2022] GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c => generated 1739 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:13:41.209510 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-417e84ef-27b8-4cac-becd-cac950fb8773 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:13:41.210839 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-417e84ef-27b8-4cac-becd-cac950fb8773 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: cddfb0ad-63f6-4b0d-bf12-d388bfb0714c] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:13:41.220928 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-417e84ef-27b8-4cac-becd-cac950fb8773 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:41.222344 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-417e84ef-27b8-4cac-becd-cac950fb8773 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:41.223113 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-417e84ef-27b8-4cac-becd-cac950fb8773 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:41.229194 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-417e84ef-27b8-4cac-becd-cac950fb8773 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:41.735271 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-417e84ef-27b8-4cac-becd-cac950fb8773 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:41.747113 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-417e84ef-27b8-4cac-becd-cac950fb8773 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:41.749826 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-417e84ef-27b8-4cac-becd-cac950fb8773 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:41.751666 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-417e84ef-27b8-4cac-becd-cac950fb8773 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c" status: 200 len: 1739 microversion: 2.20 time: 0.545994 Jun 07 22:13:41.764243 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 616/1238] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:13:41 2022] GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c => generated 1739 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:13:42.098917 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [req-06495930-7dfd-4f3b-82be-fd80ab89ce60 req-ec11196e-909c-401e-888c-3e81e5b16dc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "396f0b5c-2d4c-486e-9ab6-b781fc612a4a", "tag": "5b7c7edd-c543-41ae-bf73-9c85442dfb14"}]} {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:13:42.109157 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-06495930-7dfd-4f3b-82be-fd80ab89ce60 req-ec11196e-909c-401e-888c-3e81e5b16dc5 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:42.109986 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-06495930-7dfd-4f3b-82be-fd80ab89ce60 req-ec11196e-909c-401e-888c-3e81e5b16dc5 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:42.121863 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.compute.server_external_events [req-06495930-7dfd-4f3b-82be-fd80ab89ce60 req-ec11196e-909c-401e-888c-3e81e5b16dc5 service nova] Creating event network-changed:5b7c7edd-c543-41ae-bf73-9c85442dfb14 for instance 396f0b5c-2d4c-486e-9ab6-b781fc612a4a on hv-cinder-83552 Jun 07 22:13:42.130735 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [req-06495930-7dfd-4f3b-82be-fd80ab89ce60 req-ec11196e-909c-401e-888c-3e81e5b16dc5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036422 Jun 07 22:13:42.131983 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 623/1239] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:13:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:13:42.773532 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-d984c441-2354-4eae-9945-6b3c532a4e5e tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:13:42.774477 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-d984c441-2354-4eae-9945-6b3c532a4e5e tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: cddfb0ad-63f6-4b0d-bf12-d388bfb0714c] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:13:42.781192 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d984c441-2354-4eae-9945-6b3c532a4e5e tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:42.781626 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d984c441-2354-4eae-9945-6b3c532a4e5e tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:42.782395 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d984c441-2354-4eae-9945-6b3c532a4e5e tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:42.782828 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d984c441-2354-4eae-9945-6b3c532a4e5e tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:42.951736 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-d984c441-2354-4eae-9945-6b3c532a4e5e tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:42.966243 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-d984c441-2354-4eae-9945-6b3c532a4e5e tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:42.968555 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-d984c441-2354-4eae-9945-6b3c532a4e5e tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:42.970100 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-d984c441-2354-4eae-9945-6b3c532a4e5e tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c" status: 200 len: 1739 microversion: 2.20 time: 0.202192 Jun 07 22:13:42.971189 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 617/1240] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:13:42 2022] GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c => generated 1739 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 22:13:43.990495 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-887edbb7-3728-47c9-b016-725c74ed6465 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:13:43.991343 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-887edbb7-3728-47c9-b016-725c74ed6465 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: cddfb0ad-63f6-4b0d-bf12-d388bfb0714c] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:13:43.998366 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-887edbb7-3728-47c9-b016-725c74ed6465 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:43.999640 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-887edbb7-3728-47c9-b016-725c74ed6465 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:44.000740 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-887edbb7-3728-47c9-b016-725c74ed6465 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:44.001416 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-887edbb7-3728-47c9-b016-725c74ed6465 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:44.148710 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-887edbb7-3728-47c9-b016-725c74ed6465 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:44.157181 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-887edbb7-3728-47c9-b016-725c74ed6465 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:44.159113 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-887edbb7-3728-47c9-b016-725c74ed6465 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:44.160441 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-887edbb7-3728-47c9-b016-725c74ed6465 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c" status: 200 len: 1739 microversion: 2.20 time: 0.175174 Jun 07 22:13:44.172041 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 624/1241] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:13:43 2022] GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c => generated 1739 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:13:45.034284 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-04818586-29ef-4623-a825-9e40eec40457 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:13:45.034794 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-04818586-29ef-4623-a825-9e40eec40457 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: c00b6e50-3d0c-4614-bf39-f36ae4169292] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:13:45.040968 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-04818586-29ef-4623-a825-9e40eec40457 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:45.041422 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-04818586-29ef-4623-a825-9e40eec40457 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:45.042255 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-04818586-29ef-4623-a825-9e40eec40457 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:45.042759 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-04818586-29ef-4623-a825-9e40eec40457 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:45.066201 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-04818586-29ef-4623-a825-9e40eec40457 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/c00b6e50-3d0c-4614-bf39-f36ae4169292/ips" status: 200 len: 144 microversion: 2.1 time: 0.203017 Jun 07 22:13:45.066748 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 618/1242] 10.222.0.13 () {58 vars in 1247 bytes} [Tue Jun 7 22:13:44 2022] GET /compute/v2.1/servers/c00b6e50-3d0c-4614-bf39-f36ae4169292/ips => generated 144 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:13:45.179546 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-b9bd960a-73f4-418d-8dde-1b0d4db89e4d tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:13:45.180151 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-b9bd960a-73f4-418d-8dde-1b0d4db89e4d tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: cddfb0ad-63f6-4b0d-bf12-d388bfb0714c] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:13:45.188904 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b9bd960a-73f4-418d-8dde-1b0d4db89e4d tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:45.189636 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b9bd960a-73f4-418d-8dde-1b0d4db89e4d tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:45.190420 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b9bd960a-73f4-418d-8dde-1b0d4db89e4d tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:45.190865 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b9bd960a-73f4-418d-8dde-1b0d4db89e4d tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:45.361945 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-b9bd960a-73f4-418d-8dde-1b0d4db89e4d tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:45.376326 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-b9bd960a-73f4-418d-8dde-1b0d4db89e4d tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:45.379390 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-b9bd960a-73f4-418d-8dde-1b0d4db89e4d tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:45.381183 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-b9bd960a-73f4-418d-8dde-1b0d4db89e4d tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c" status: 200 len: 1739 microversion: 2.20 time: 0.206760 Jun 07 22:13:45.381845 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 625/1243] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:13:45 2022] GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c => generated 1739 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:13:46.399780 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-080a6e53-908f-4790-92ac-3b721452a3b6 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:13:46.401220 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-080a6e53-908f-4790-92ac-3b721452a3b6 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: cddfb0ad-63f6-4b0d-bf12-d388bfb0714c] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:13:46.403713 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:13:46.409420 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-080a6e53-908f-4790-92ac-3b721452a3b6 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:46.410000 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-080a6e53-908f-4790-92ac-3b721452a3b6 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:46.410782 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-080a6e53-908f-4790-92ac-3b721452a3b6 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:46.411216 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-080a6e53-908f-4790-92ac-3b721452a3b6 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:46.502353 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-35cf7a28-01a4-444c-ab40-50a9e38a7644 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1b9f52fc-1eab-459e-8d9c-ab139f0a15d3"}} {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:13:46.503459 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-35cf7a28-01a4-444c-ab40-50a9e38a7644 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: c00b6e50-3d0c-4614-bf39-f36ae4169292] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:13:46.510404 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-35cf7a28-01a4-444c-ab40-50a9e38a7644 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:46.510862 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-35cf7a28-01a4-444c-ab40-50a9e38a7644 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:46.511846 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-35cf7a28-01a4-444c-ab40-50a9e38a7644 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:46.512439 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-35cf7a28-01a4-444c-ab40-50a9e38a7644 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:46.574779 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-080a6e53-908f-4790-92ac-3b721452a3b6 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:46.586155 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-080a6e53-908f-4790-92ac-3b721452a3b6 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:46.587866 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-080a6e53-908f-4790-92ac-3b721452a3b6 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:46.589098 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-080a6e53-908f-4790-92ac-3b721452a3b6 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c" status: 200 len: 1739 microversion: 2.20 time: 0.194267 Jun 07 22:13:46.589673 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 619/1244] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:13:46 2022] GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c => generated 1739 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 22:13:46.826191 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-35cf7a28-01a4-444c-ab40-50a9e38a7644 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "POST /compute/v2.1/servers/c00b6e50-3d0c-4614-bf39-f36ae4169292/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.328357 Jun 07 22:13:46.826787 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 626/1245] 10.222.0.13 () {60 vars in 1322 bytes} [Tue Jun 7 22:13:46 2022] POST /compute/v2.1/servers/c00b6e50-3d0c-4614-bf39-f36ae4169292/os-volume_attachments => generated 194 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:13:47.606974 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-e82f3ab7-07ad-409e-a999-ce6905d79e2d tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:13:47.607622 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-e82f3ab7-07ad-409e-a999-ce6905d79e2d tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: cddfb0ad-63f6-4b0d-bf12-d388bfb0714c] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:13:47.614317 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e82f3ab7-07ad-409e-a999-ce6905d79e2d tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:47.614763 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e82f3ab7-07ad-409e-a999-ce6905d79e2d tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:47.615546 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e82f3ab7-07ad-409e-a999-ce6905d79e2d tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:47.615981 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e82f3ab7-07ad-409e-a999-ce6905d79e2d tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:47.746138 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-e82f3ab7-07ad-409e-a999-ce6905d79e2d tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:47.755517 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-e82f3ab7-07ad-409e-a999-ce6905d79e2d tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:47.757501 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-e82f3ab7-07ad-409e-a999-ce6905d79e2d tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:47.759095 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-e82f3ab7-07ad-409e-a999-ce6905d79e2d tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c" status: 200 len: 1739 microversion: 2.20 time: 0.156126 Jun 07 22:13:47.759567 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 620/1246] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:13:47 2022] GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c => generated 1739 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 22:13:48.778807 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-42d2b6a6-0d9f-4225-b29b-9e8f34d0fe55 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:13:48.779538 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-42d2b6a6-0d9f-4225-b29b-9e8f34d0fe55 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: cddfb0ad-63f6-4b0d-bf12-d388bfb0714c] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:13:48.782171 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_api:SELECT=55 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:13:48.788226 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-42d2b6a6-0d9f-4225-b29b-9e8f34d0fe55 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:48.788682 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-42d2b6a6-0d9f-4225-b29b-9e8f34d0fe55 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:48.789450 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-42d2b6a6-0d9f-4225-b29b-9e8f34d0fe55 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:48.789889 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-42d2b6a6-0d9f-4225-b29b-9e8f34d0fe55 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:48.918962 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-42d2b6a6-0d9f-4225-b29b-9e8f34d0fe55 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:48.926765 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-42d2b6a6-0d9f-4225-b29b-9e8f34d0fe55 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:48.928289 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-42d2b6a6-0d9f-4225-b29b-9e8f34d0fe55 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:48.929432 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-42d2b6a6-0d9f-4225-b29b-9e8f34d0fe55 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c" status: 200 len: 1721 microversion: 2.20 time: 0.155668 Jun 07 22:13:48.929982 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 627/1247] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:13:48 2022] GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:13:49.947585 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-fcc5e50d-23ca-42be-a194-cd797a228748 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:13:49.948194 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-fcc5e50d-23ca-42be-a194-cd797a228748 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: cddfb0ad-63f6-4b0d-bf12-d388bfb0714c] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:13:49.954820 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-fcc5e50d-23ca-42be-a194-cd797a228748 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:49.955267 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-fcc5e50d-23ca-42be-a194-cd797a228748 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:49.956040 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-fcc5e50d-23ca-42be-a194-cd797a228748 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:49.956479 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-fcc5e50d-23ca-42be-a194-cd797a228748 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:50.088805 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-fcc5e50d-23ca-42be-a194-cd797a228748 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:50.097332 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-fcc5e50d-23ca-42be-a194-cd797a228748 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:50.098819 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-fcc5e50d-23ca-42be-a194-cd797a228748 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:50.099994 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-fcc5e50d-23ca-42be-a194-cd797a228748 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c" status: 200 len: 1721 microversion: 2.20 time: 0.156352 Jun 07 22:13:50.100625 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 621/1248] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:13:49 2022] GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:13:50.896657 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [req-46a1de0d-34d9-4870-a3cc-3800ce0383d0 req-26e5ef24-b5b2-4b33-ae69-60b73ea250eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cddfb0ad-63f6-4b0d-bf12-d388bfb0714c", "name": "network-vif-unplugged", "status": "completed", "tag": "e1237eb4-3f3b-48bf-97bb-9e2c3cfc48b3"}]} {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:13:50.905746 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-46a1de0d-34d9-4870-a3cc-3800ce0383d0 req-26e5ef24-b5b2-4b33-ae69-60b73ea250eb service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:50.906300 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-46a1de0d-34d9-4870-a3cc-3800ce0383d0 req-26e5ef24-b5b2-4b33-ae69-60b73ea250eb service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:50.918775 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.compute.server_external_events [req-46a1de0d-34d9-4870-a3cc-3800ce0383d0 req-26e5ef24-b5b2-4b33-ae69-60b73ea250eb service nova] Creating event network-vif-unplugged:e1237eb4-3f3b-48bf-97bb-9e2c3cfc48b3 for instance cddfb0ad-63f6-4b0d-bf12-d388bfb0714c on hv-cinder-83552 Jun 07 22:13:50.924673 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [req-46a1de0d-34d9-4870-a3cc-3800ce0383d0 req-26e5ef24-b5b2-4b33-ae69-60b73ea250eb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031739 Jun 07 22:13:50.925269 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 628/1249] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:13:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:13:51.119377 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-57cd59bd-d331-48fa-ac9f-ba64ea31f951 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:13:51.119973 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-57cd59bd-d331-48fa-ac9f-ba64ea31f951 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: cddfb0ad-63f6-4b0d-bf12-d388bfb0714c] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:13:51.127797 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-57cd59bd-d331-48fa-ac9f-ba64ea31f951 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:51.128235 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-57cd59bd-d331-48fa-ac9f-ba64ea31f951 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:51.128983 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-57cd59bd-d331-48fa-ac9f-ba64ea31f951 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:51.129410 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-57cd59bd-d331-48fa-ac9f-ba64ea31f951 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:51.264925 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-57cd59bd-d331-48fa-ac9f-ba64ea31f951 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:51.274530 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-57cd59bd-d331-48fa-ac9f-ba64ea31f951 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:51.276058 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-57cd59bd-d331-48fa-ac9f-ba64ea31f951 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:51.277260 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-57cd59bd-d331-48fa-ac9f-ba64ea31f951 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c" status: 200 len: 1664 microversion: 2.20 time: 0.161904 Jun 07 22:13:51.277825 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 622/1250] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:13:51 2022] GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c => generated 1664 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:13:51.297752 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-91223ae3-40b0-4b61-9c90-472760d7a653 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9d79d05e-c09d-4c8b-8940-cf8c000ba75f"}} {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:13:51.298817 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-91223ae3-40b0-4b61-9c90-472760d7a653 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: cddfb0ad-63f6-4b0d-bf12-d388bfb0714c] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:13:51.305043 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-91223ae3-40b0-4b61-9c90-472760d7a653 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:51.305484 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-91223ae3-40b0-4b61-9c90-472760d7a653 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:51.306244 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-91223ae3-40b0-4b61-9c90-472760d7a653 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:51.306691 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-91223ae3-40b0-4b61-9c90-472760d7a653 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:51.575845 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-91223ae3-40b0-4b61-9c90-472760d7a653 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "POST /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.283190 Jun 07 22:13:51.576455 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 629/1251] 10.222.0.13 () {62 vars in 1363 bytes} [Tue Jun 7 22:13:51 2022] POST /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c/os-volume_attachments => generated 188 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 22:13:51.690922 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-dcc8ea83-cce7-4d62-9bbf-5be9ec7ef953 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:13:51.691439 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-dcc8ea83-cce7-4d62-9bbf-5be9ec7ef953 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: cddfb0ad-63f6-4b0d-bf12-d388bfb0714c] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:13:51.697317 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-dcc8ea83-cce7-4d62-9bbf-5be9ec7ef953 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:51.697772 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-dcc8ea83-cce7-4d62-9bbf-5be9ec7ef953 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:51.698506 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-dcc8ea83-cce7-4d62-9bbf-5be9ec7ef953 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:51.698934 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-dcc8ea83-cce7-4d62-9bbf-5be9ec7ef953 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:51.942077 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-dcc8ea83-cce7-4d62-9bbf-5be9ec7ef953 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "DELETE /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c/os-volume_attachments/9d79d05e-c09d-4c8b-8940-cf8c000ba75f" status: 202 len: 0 microversion: 2.20 time: 0.254997 Jun 07 22:13:51.942670 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 623/1252] 10.222.0.13 () {60 vars in 1456 bytes} [Tue Jun 7 22:13:51 2022] DELETE /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c/os-volume_attachments/9d79d05e-c09d-4c8b-8940-cf8c000ba75f => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 07 22:13:51.997408 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-9369413c-6e8d-40c7-a62a-2b0194135f16 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:13:51.997968 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-9369413c-6e8d-40c7-a62a-2b0194135f16 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: cddfb0ad-63f6-4b0d-bf12-d388bfb0714c] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:13:52.004245 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-9369413c-6e8d-40c7-a62a-2b0194135f16 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:52.004685 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-9369413c-6e8d-40c7-a62a-2b0194135f16 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:52.005426 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-9369413c-6e8d-40c7-a62a-2b0194135f16 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:52.005854 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-9369413c-6e8d-40c7-a62a-2b0194135f16 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:52.067542 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:13:52.100267 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-9369413c-6e8d-40c7-a62a-2b0194135f16 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "POST /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c/action" status: 202 len: 0 microversion: 2.20 time: 0.106704 Jun 07 22:13:52.100850 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 630/1253] 10.222.0.13 () {62 vars in 1318 bytes} [Tue Jun 7 22:13:51 2022] POST /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 07 22:13:52.116805 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-556e04f3-77a5-4400-9828-14aa9004b49c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:13:52.117419 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-556e04f3-77a5-4400-9828-14aa9004b49c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: cddfb0ad-63f6-4b0d-bf12-d388bfb0714c] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:13:52.124659 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-556e04f3-77a5-4400-9828-14aa9004b49c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:52.125399 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-556e04f3-77a5-4400-9828-14aa9004b49c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:52.125778 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-556e04f3-77a5-4400-9828-14aa9004b49c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:52.126418 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-556e04f3-77a5-4400-9828-14aa9004b49c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:52.259288 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-556e04f3-77a5-4400-9828-14aa9004b49c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:52.267867 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-556e04f3-77a5-4400-9828-14aa9004b49c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:52.269362 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-556e04f3-77a5-4400-9828-14aa9004b49c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:52.270523 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-556e04f3-77a5-4400-9828-14aa9004b49c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c" status: 200 len: 1672 microversion: 2.20 time: 0.158742 Jun 07 22:13:52.271081 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 624/1254] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:13:52 2022] GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c => generated 1672 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:13:53.288715 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-51ee83d5-9698-4345-a98b-72ce01dd733a tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:13:53.289310 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-51ee83d5-9698-4345-a98b-72ce01dd733a tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: cddfb0ad-63f6-4b0d-bf12-d388bfb0714c] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:13:53.296168 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-51ee83d5-9698-4345-a98b-72ce01dd733a tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:53.296625 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-51ee83d5-9698-4345-a98b-72ce01dd733a tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:53.297392 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-51ee83d5-9698-4345-a98b-72ce01dd733a tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:53.297839 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-51ee83d5-9698-4345-a98b-72ce01dd733a tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:53.428790 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-51ee83d5-9698-4345-a98b-72ce01dd733a tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:53.437299 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-51ee83d5-9698-4345-a98b-72ce01dd733a tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:53.438836 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-51ee83d5-9698-4345-a98b-72ce01dd733a tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:53.440021 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-51ee83d5-9698-4345-a98b-72ce01dd733a tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c" status: 200 len: 1730 microversion: 2.20 time: 0.155220 Jun 07 22:13:53.440579 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 631/1255] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:13:53 2022] GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:13:54.457972 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-c0723953-7daa-46c5-be17-33ea2b39aa6c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:13:54.458654 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-c0723953-7daa-46c5-be17-33ea2b39aa6c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: cddfb0ad-63f6-4b0d-bf12-d388bfb0714c] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:13:54.465199 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c0723953-7daa-46c5-be17-33ea2b39aa6c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:54.465643 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c0723953-7daa-46c5-be17-33ea2b39aa6c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:54.466394 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c0723953-7daa-46c5-be17-33ea2b39aa6c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:54.466830 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c0723953-7daa-46c5-be17-33ea2b39aa6c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:54.679091 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-c0723953-7daa-46c5-be17-33ea2b39aa6c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:54.687047 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-c0723953-7daa-46c5-be17-33ea2b39aa6c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:54.688695 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-c0723953-7daa-46c5-be17-33ea2b39aa6c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:54.689850 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-c0723953-7daa-46c5-be17-33ea2b39aa6c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c" status: 200 len: 1730 microversion: 2.20 time: 0.235788 Jun 07 22:13:54.690408 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 625/1256] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:13:54 2022] GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c => generated 1730 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:13:55.409172 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-a5d429ce-9ab0-44c1-9c6f-03e03df86369 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:13:55.410389 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-a5d429ce-9ab0-44c1-9c6f-03e03df86369 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: c00b6e50-3d0c-4614-bf39-f36ae4169292] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:13:55.417677 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a5d429ce-9ab0-44c1-9c6f-03e03df86369 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:55.418206 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a5d429ce-9ab0-44c1-9c6f-03e03df86369 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:55.419034 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a5d429ce-9ab0-44c1-9c6f-03e03df86369 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:55.419569 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a5d429ce-9ab0-44c1-9c6f-03e03df86369 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:55.451011 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-a5d429ce-9ab0-44c1-9c6f-03e03df86369 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/c00b6e50-3d0c-4614-bf39-f36ae4169292/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045924 Jun 07 22:13:55.451758 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 632/1257] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jun 7 22:13:55 2022] GET /compute/v2.1/servers/c00b6e50-3d0c-4614-bf39-f36ae4169292/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:13:55.462374 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-f65ba5c2-31c3-475d-8591-153a1c82a33d tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:13:55.463480 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-f65ba5c2-31c3-475d-8591-153a1c82a33d tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: c00b6e50-3d0c-4614-bf39-f36ae4169292] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:13:55.470382 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f65ba5c2-31c3-475d-8591-153a1c82a33d tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:55.471176 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f65ba5c2-31c3-475d-8591-153a1c82a33d tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:55.472121 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f65ba5c2-31c3-475d-8591-153a1c82a33d tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:55.472736 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f65ba5c2-31c3-475d-8591-153a1c82a33d tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:55.502597 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-f65ba5c2-31c3-475d-8591-153a1c82a33d tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/c00b6e50-3d0c-4614-bf39-f36ae4169292/os-volume_attachments/1b9f52fc-1eab-459e-8d9c-ab139f0a15d3" status: 200 len: 194 microversion: 2.1 time: 0.044095 Jun 07 22:13:55.503234 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 626/1258] 10.222.0.13 () {58 vars in 1412 bytes} [Tue Jun 7 22:13:55 2022] GET /compute/v2.1/servers/c00b6e50-3d0c-4614-bf39-f36ae4169292/os-volume_attachments/1b9f52fc-1eab-459e-8d9c-ab139f0a15d3 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:13:55.709210 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-f745a5fa-37e1-4906-8f43-4e52ad34010c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:13:55.709825 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-f745a5fa-37e1-4906-8f43-4e52ad34010c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: cddfb0ad-63f6-4b0d-bf12-d388bfb0714c] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:13:55.718034 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-f745a5fa-37e1-4906-8f43-4e52ad34010c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:55.718685 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-f745a5fa-37e1-4906-8f43-4e52ad34010c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:55.719999 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-f745a5fa-37e1-4906-8f43-4e52ad34010c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:55.720604 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-f745a5fa-37e1-4906-8f43-4e52ad34010c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:55.900749 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-f745a5fa-37e1-4906-8f43-4e52ad34010c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:55.909525 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-f745a5fa-37e1-4906-8f43-4e52ad34010c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:55.911135 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-f745a5fa-37e1-4906-8f43-4e52ad34010c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:55.912502 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-f745a5fa-37e1-4906-8f43-4e52ad34010c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c" status: 200 len: 1730 microversion: 2.20 time: 0.208229 Jun 07 22:13:55.913068 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 633/1259] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:13:55 2022] GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c => generated 1730 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:13:56.853256 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-e7f3ac22-500d-486e-9cdd-5e63ee100230 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e3433c7e-82c1-480f-b417-8b89817b433b"}} {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:13:56.854396 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-e7f3ac22-500d-486e-9cdd-5e63ee100230 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: c00b6e50-3d0c-4614-bf39-f36ae4169292] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:13:56.860980 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e7f3ac22-500d-486e-9cdd-5e63ee100230 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:56.861427 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e7f3ac22-500d-486e-9cdd-5e63ee100230 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:56.862185 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e7f3ac22-500d-486e-9cdd-5e63ee100230 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:56.862624 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e7f3ac22-500d-486e-9cdd-5e63ee100230 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:56.930000 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-a7068858-37ba-4d9a-af02-7822393cb83b tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:13:56.930619 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-a7068858-37ba-4d9a-af02-7822393cb83b tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: cddfb0ad-63f6-4b0d-bf12-d388bfb0714c] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:13:56.937962 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a7068858-37ba-4d9a-af02-7822393cb83b tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:56.938671 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a7068858-37ba-4d9a-af02-7822393cb83b tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:56.939645 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a7068858-37ba-4d9a-af02-7822393cb83b tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:56.940305 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a7068858-37ba-4d9a-af02-7822393cb83b tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:57.072853 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-a7068858-37ba-4d9a-af02-7822393cb83b tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:57.082305 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-a7068858-37ba-4d9a-af02-7822393cb83b tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:57.083814 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-a7068858-37ba-4d9a-af02-7822393cb83b tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:57.084959 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-a7068858-37ba-4d9a-af02-7822393cb83b tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c" status: 200 len: 1730 microversion: 2.20 time: 0.158926 Jun 07 22:13:57.085521 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 634/1260] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:13:56 2022] GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 22:13:58.104984 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-eaf497ce-e1ab-4bf5-b3f1-a17606fbea7d tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:13:58.107116 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-eaf497ce-e1ab-4bf5-b3f1-a17606fbea7d tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: cddfb0ad-63f6-4b0d-bf12-d388bfb0714c] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:13:58.116791 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-eaf497ce-e1ab-4bf5-b3f1-a17606fbea7d tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:58.116791 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-eaf497ce-e1ab-4bf5-b3f1-a17606fbea7d tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:58.117610 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-eaf497ce-e1ab-4bf5-b3f1-a17606fbea7d tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:58.118041 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-eaf497ce-e1ab-4bf5-b3f1-a17606fbea7d tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:58.247826 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-eaf497ce-e1ab-4bf5-b3f1-a17606fbea7d tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:58.255699 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-eaf497ce-e1ab-4bf5-b3f1-a17606fbea7d tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:58.257194 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-eaf497ce-e1ab-4bf5-b3f1-a17606fbea7d tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:58.258342 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-eaf497ce-e1ab-4bf5-b3f1-a17606fbea7d tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c" status: 200 len: 1730 microversion: 2.20 time: 0.158951 Jun 07 22:13:58.258905 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 635/1261] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:13:58 2022] GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 22:13:59.276198 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-37252b7c-618b-4a78-bdb8-975f8eb3ebd2 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:13:59.276833 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-37252b7c-618b-4a78-bdb8-975f8eb3ebd2 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: cddfb0ad-63f6-4b0d-bf12-d388bfb0714c] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:13:59.284023 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-37252b7c-618b-4a78-bdb8-975f8eb3ebd2 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:59.284472 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-37252b7c-618b-4a78-bdb8-975f8eb3ebd2 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:59.285242 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-37252b7c-618b-4a78-bdb8-975f8eb3ebd2 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:13:59.285682 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-37252b7c-618b-4a78-bdb8-975f8eb3ebd2 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:13:59.422758 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-37252b7c-618b-4a78-bdb8-975f8eb3ebd2 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:59.434407 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-37252b7c-618b-4a78-bdb8-975f8eb3ebd2 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:59.436867 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-37252b7c-618b-4a78-bdb8-975f8eb3ebd2 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:13:59.438147 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-37252b7c-618b-4a78-bdb8-975f8eb3ebd2 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c" status: 200 len: 1730 microversion: 2.20 time: 0.165900 Jun 07 22:13:59.438703 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 636/1262] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:13:59 2022] GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 22:14:00.456324 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-0d8657d8-bf45-485d-8753-f0ca89ebd24e tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:14:00.457008 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-0d8657d8-bf45-485d-8753-f0ca89ebd24e tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: cddfb0ad-63f6-4b0d-bf12-d388bfb0714c] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:14:00.463924 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-0d8657d8-bf45-485d-8753-f0ca89ebd24e tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:00.464457 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-0d8657d8-bf45-485d-8753-f0ca89ebd24e tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:00.465311 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-0d8657d8-bf45-485d-8753-f0ca89ebd24e tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:00.465749 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-0d8657d8-bf45-485d-8753-f0ca89ebd24e tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:00.603491 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-0d8657d8-bf45-485d-8753-f0ca89ebd24e tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:14:00.610698 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-0d8657d8-bf45-485d-8753-f0ca89ebd24e tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:14:00.612224 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-0d8657d8-bf45-485d-8753-f0ca89ebd24e tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:14:00.613398 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-0d8657d8-bf45-485d-8753-f0ca89ebd24e tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c" status: 200 len: 1730 microversion: 2.20 time: 0.161608 Jun 07 22:14:00.624436 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 637/1263] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:14:00 2022] GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 22:14:01.633882 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-5a5b860a-b054-40aa-945e-3e7fbcba3261 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:14:01.634609 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-5a5b860a-b054-40aa-945e-3e7fbcba3261 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: cddfb0ad-63f6-4b0d-bf12-d388bfb0714c] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:14:01.641573 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-5a5b860a-b054-40aa-945e-3e7fbcba3261 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:01.642017 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-5a5b860a-b054-40aa-945e-3e7fbcba3261 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:01.642776 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-5a5b860a-b054-40aa-945e-3e7fbcba3261 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:01.643203 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-5a5b860a-b054-40aa-945e-3e7fbcba3261 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:01.774785 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-5a5b860a-b054-40aa-945e-3e7fbcba3261 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:14:01.782925 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-5a5b860a-b054-40aa-945e-3e7fbcba3261 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:14:01.784468 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-5a5b860a-b054-40aa-945e-3e7fbcba3261 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:14:01.785624 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-5a5b860a-b054-40aa-945e-3e7fbcba3261 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c" status: 200 len: 1730 microversion: 2.20 time: 0.155631 Jun 07 22:14:01.786357 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 638/1264] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:14:01 2022] GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 22:14:02.805440 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-30a5ccf5-ed30-48e6-9de4-f3cffd679a9d tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:14:02.806232 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-30a5ccf5-ed30-48e6-9de4-f3cffd679a9d tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: cddfb0ad-63f6-4b0d-bf12-d388bfb0714c] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:14:02.812808 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-30a5ccf5-ed30-48e6-9de4-f3cffd679a9d tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:02.814284 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-30a5ccf5-ed30-48e6-9de4-f3cffd679a9d tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:02.815133 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-30a5ccf5-ed30-48e6-9de4-f3cffd679a9d tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:02.815602 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-30a5ccf5-ed30-48e6-9de4-f3cffd679a9d tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:02.948622 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-30a5ccf5-ed30-48e6-9de4-f3cffd679a9d tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:14:02.957134 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-30a5ccf5-ed30-48e6-9de4-f3cffd679a9d tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:14:02.958638 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-30a5ccf5-ed30-48e6-9de4-f3cffd679a9d tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:14:02.959833 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-30a5ccf5-ed30-48e6-9de4-f3cffd679a9d tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c" status: 200 len: 1730 microversion: 2.20 time: 0.158908 Jun 07 22:14:02.960390 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 639/1265] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:14:02 2022] GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:14:03.978292 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-41161be1-6313-4f46-9492-849aaa8c422c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:14:03.979001 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-41161be1-6313-4f46-9492-849aaa8c422c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: cddfb0ad-63f6-4b0d-bf12-d388bfb0714c] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:14:03.986084 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-41161be1-6313-4f46-9492-849aaa8c422c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:03.986521 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-41161be1-6313-4f46-9492-849aaa8c422c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:03.987264 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-41161be1-6313-4f46-9492-849aaa8c422c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:03.987715 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-41161be1-6313-4f46-9492-849aaa8c422c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:04.117697 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-41161be1-6313-4f46-9492-849aaa8c422c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:14:04.125443 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-41161be1-6313-4f46-9492-849aaa8c422c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:14:04.127578 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-41161be1-6313-4f46-9492-849aaa8c422c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:14:04.128721 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-41161be1-6313-4f46-9492-849aaa8c422c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c" status: 200 len: 1730 microversion: 2.20 time: 0.154576 Jun 07 22:14:04.129271 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 640/1266] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:14:03 2022] GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 22:14:05.147767 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-ded3f82a-e1a9-4a8e-9f2f-e2758727719c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:14:05.148605 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-ded3f82a-e1a9-4a8e-9f2f-e2758727719c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: cddfb0ad-63f6-4b0d-bf12-d388bfb0714c] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:14:05.155657 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ded3f82a-e1a9-4a8e-9f2f-e2758727719c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:05.156100 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ded3f82a-e1a9-4a8e-9f2f-e2758727719c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:05.156868 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ded3f82a-e1a9-4a8e-9f2f-e2758727719c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:05.157507 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ded3f82a-e1a9-4a8e-9f2f-e2758727719c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:05.523029 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-ded3f82a-e1a9-4a8e-9f2f-e2758727719c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:14:05.530744 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-ded3f82a-e1a9-4a8e-9f2f-e2758727719c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:14:05.532503 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-ded3f82a-e1a9-4a8e-9f2f-e2758727719c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:14:05.533647 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-ded3f82a-e1a9-4a8e-9f2f-e2758727719c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c" status: 200 len: 1730 microversion: 2.20 time: 0.390553 Jun 07 22:14:05.534230 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 641/1267] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:14:05 2022] GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c => generated 1730 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 22:14:06.552093 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-8e559f06-1f64-4665-a270-d3735badf5e9 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:14:06.552779 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-8e559f06-1f64-4665-a270-d3735badf5e9 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: cddfb0ad-63f6-4b0d-bf12-d388bfb0714c] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:14:06.559148 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-8e559f06-1f64-4665-a270-d3735badf5e9 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:06.559618 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-8e559f06-1f64-4665-a270-d3735badf5e9 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:06.560367 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-8e559f06-1f64-4665-a270-d3735badf5e9 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:06.560790 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-8e559f06-1f64-4665-a270-d3735badf5e9 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:06.698978 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-8e559f06-1f64-4665-a270-d3735badf5e9 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:14:06.707835 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-8e559f06-1f64-4665-a270-d3735badf5e9 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:14:06.709376 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-8e559f06-1f64-4665-a270-d3735badf5e9 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:14:06.710533 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-8e559f06-1f64-4665-a270-d3735badf5e9 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c" status: 200 len: 1730 microversion: 2.20 time: 0.162877 Jun 07 22:14:06.711088 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 642/1268] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:14:06 2022] GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 22:14:06.859668 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_api:SELECT=17 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:14:06.935654 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:14:07.729123 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-969bd9aa-b906-44a2-8b35-5734c70afb18 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:14:07.729711 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-969bd9aa-b906-44a2-8b35-5734c70afb18 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: cddfb0ad-63f6-4b0d-bf12-d388bfb0714c] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:14:07.737063 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-969bd9aa-b906-44a2-8b35-5734c70afb18 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:07.738011 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-969bd9aa-b906-44a2-8b35-5734c70afb18 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:07.739108 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-969bd9aa-b906-44a2-8b35-5734c70afb18 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:07.739848 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-969bd9aa-b906-44a2-8b35-5734c70afb18 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:07.879179 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-969bd9aa-b906-44a2-8b35-5734c70afb18 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:14:07.887082 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-969bd9aa-b906-44a2-8b35-5734c70afb18 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:14:07.888622 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-969bd9aa-b906-44a2-8b35-5734c70afb18 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:14:07.889779 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-969bd9aa-b906-44a2-8b35-5734c70afb18 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c" status: 200 len: 1730 microversion: 2.20 time: 0.165040 Jun 07 22:14:07.890335 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 643/1269] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:14:07 2022] GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 22:14:08.908437 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-4ddd87e7-d1cd-4e21-a6e0-f68492a5f789 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:14:08.909084 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-4ddd87e7-d1cd-4e21-a6e0-f68492a5f789 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: cddfb0ad-63f6-4b0d-bf12-d388bfb0714c] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:14:08.916485 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-4ddd87e7-d1cd-4e21-a6e0-f68492a5f789 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:08.916937 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-4ddd87e7-d1cd-4e21-a6e0-f68492a5f789 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:08.917709 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-4ddd87e7-d1cd-4e21-a6e0-f68492a5f789 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:08.918146 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-4ddd87e7-d1cd-4e21-a6e0-f68492a5f789 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:09.051055 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-4ddd87e7-d1cd-4e21-a6e0-f68492a5f789 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:14:09.059595 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-4ddd87e7-d1cd-4e21-a6e0-f68492a5f789 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:14:09.061093 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-4ddd87e7-d1cd-4e21-a6e0-f68492a5f789 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:14:09.062254 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-4ddd87e7-d1cd-4e21-a6e0-f68492a5f789 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c" status: 200 len: 1730 microversion: 2.20 time: 0.157696 Jun 07 22:14:09.062812 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 644/1270] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:14:08 2022] GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:14:10.080287 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-b6a76c8b-edd2-4020-988a-2b040d47fc52 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:14:10.080972 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-b6a76c8b-edd2-4020-988a-2b040d47fc52 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: cddfb0ad-63f6-4b0d-bf12-d388bfb0714c] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:14:10.088397 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b6a76c8b-edd2-4020-988a-2b040d47fc52 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:10.088844 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b6a76c8b-edd2-4020-988a-2b040d47fc52 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:10.089600 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b6a76c8b-edd2-4020-988a-2b040d47fc52 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:10.090033 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b6a76c8b-edd2-4020-988a-2b040d47fc52 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:10.224901 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-b6a76c8b-edd2-4020-988a-2b040d47fc52 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:14:10.232941 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-b6a76c8b-edd2-4020-988a-2b040d47fc52 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:14:10.234432 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-b6a76c8b-edd2-4020-988a-2b040d47fc52 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:14:10.235598 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-b6a76c8b-edd2-4020-988a-2b040d47fc52 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c" status: 200 len: 1730 microversion: 2.20 time: 0.159223 Jun 07 22:14:10.236155 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 645/1271] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:14:10 2022] GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 22:14:11.254221 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-c41748a7-c329-4108-847a-032aaefc0f19 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:14:11.254828 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-c41748a7-c329-4108-847a-032aaefc0f19 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: cddfb0ad-63f6-4b0d-bf12-d388bfb0714c] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:14:11.261467 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c41748a7-c329-4108-847a-032aaefc0f19 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:11.261919 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c41748a7-c329-4108-847a-032aaefc0f19 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:11.262693 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c41748a7-c329-4108-847a-032aaefc0f19 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:11.263127 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c41748a7-c329-4108-847a-032aaefc0f19 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:11.389631 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-c41748a7-c329-4108-847a-032aaefc0f19 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:14:11.392976 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:14:11.399738 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-c41748a7-c329-4108-847a-032aaefc0f19 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:14:11.401228 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-c41748a7-c329-4108-847a-032aaefc0f19 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:14:11.402373 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-c41748a7-c329-4108-847a-032aaefc0f19 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c" status: 200 len: 1730 microversion: 2.20 time: 0.152127 Jun 07 22:14:11.402919 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 646/1272] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:14:11 2022] GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 22:14:12.421509 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-06e2883e-35b1-4a0c-80a1-43fc38221e3c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:14:12.422161 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-06e2883e-35b1-4a0c-80a1-43fc38221e3c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: cddfb0ad-63f6-4b0d-bf12-d388bfb0714c] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:14:12.430057 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-06e2883e-35b1-4a0c-80a1-43fc38221e3c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:12.430504 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-06e2883e-35b1-4a0c-80a1-43fc38221e3c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:12.431254 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-06e2883e-35b1-4a0c-80a1-43fc38221e3c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:12.431716 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-06e2883e-35b1-4a0c-80a1-43fc38221e3c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:12.555828 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-06e2883e-35b1-4a0c-80a1-43fc38221e3c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:14:12.563553 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-06e2883e-35b1-4a0c-80a1-43fc38221e3c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:14:12.565038 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-06e2883e-35b1-4a0c-80a1-43fc38221e3c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:14:12.566636 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-06e2883e-35b1-4a0c-80a1-43fc38221e3c tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c" status: 200 len: 1730 microversion: 2.20 time: 0.149157 Jun 07 22:14:12.567185 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 647/1273] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:14:12 2022] GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 22:14:13.586869 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-ebf830ad-6f4b-4776-8932-1f6da40c8bf3 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:14:13.587557 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-ebf830ad-6f4b-4776-8932-1f6da40c8bf3 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: cddfb0ad-63f6-4b0d-bf12-d388bfb0714c] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:14:13.593982 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ebf830ad-6f4b-4776-8932-1f6da40c8bf3 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:13.594424 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ebf830ad-6f4b-4776-8932-1f6da40c8bf3 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:13.595166 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ebf830ad-6f4b-4776-8932-1f6da40c8bf3 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:13.595620 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ebf830ad-6f4b-4776-8932-1f6da40c8bf3 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:13.736446 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-ebf830ad-6f4b-4776-8932-1f6da40c8bf3 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:14:13.744769 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-ebf830ad-6f4b-4776-8932-1f6da40c8bf3 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:14:13.746297 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-ebf830ad-6f4b-4776-8932-1f6da40c8bf3 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:14:13.747474 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-ebf830ad-6f4b-4776-8932-1f6da40c8bf3 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c" status: 200 len: 1730 microversion: 2.20 time: 0.166804 Jun 07 22:14:13.748028 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 648/1274] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:14:13 2022] GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 22:14:13.898229 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-e7f3ac22-500d-486e-9cdd-5e63ee100230 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "POST /compute/v2.1/servers/c00b6e50-3d0c-4614-bf39-f36ae4169292/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 17.049047 Jun 07 22:14:13.903516 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 627/1275] 10.222.0.13 () {60 vars in 1322 bytes} [Tue Jun 7 22:13:56 2022] POST /compute/v2.1/servers/c00b6e50-3d0c-4614-bf39-f36ae4169292/os-volume_attachments => generated 194 bytes in 17051 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:14:14.766117 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-fbc13e9c-4c64-4606-a12e-76cdbcb6ffdd tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:14:14.766725 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-fbc13e9c-4c64-4606-a12e-76cdbcb6ffdd tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: cddfb0ad-63f6-4b0d-bf12-d388bfb0714c] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:14:14.773863 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-fbc13e9c-4c64-4606-a12e-76cdbcb6ffdd tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:14.774302 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-fbc13e9c-4c64-4606-a12e-76cdbcb6ffdd tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:14.775050 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-fbc13e9c-4c64-4606-a12e-76cdbcb6ffdd tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:14.775500 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-fbc13e9c-4c64-4606-a12e-76cdbcb6ffdd tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:14.904465 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-fbc13e9c-4c64-4606-a12e-76cdbcb6ffdd tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:14:14.912461 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-fbc13e9c-4c64-4606-a12e-76cdbcb6ffdd tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:14:14.913952 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-fbc13e9c-4c64-4606-a12e-76cdbcb6ffdd tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:14:14.915095 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-fbc13e9c-4c64-4606-a12e-76cdbcb6ffdd tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c" status: 200 len: 1730 microversion: 2.20 time: 0.152910 Jun 07 22:14:14.915678 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 649/1276] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:14:14 2022] GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:14:15.933495 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-da459948-2de1-4d59-b174-947c42be0149 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:14:15.934186 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-da459948-2de1-4d59-b174-947c42be0149 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: cddfb0ad-63f6-4b0d-bf12-d388bfb0714c] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:14:15.941045 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-da459948-2de1-4d59-b174-947c42be0149 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:15.941565 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-da459948-2de1-4d59-b174-947c42be0149 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:15.942322 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-da459948-2de1-4d59-b174-947c42be0149 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:15.942757 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-da459948-2de1-4d59-b174-947c42be0149 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:16.075165 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-da459948-2de1-4d59-b174-947c42be0149 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:14:16.083614 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-da459948-2de1-4d59-b174-947c42be0149 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:14:16.085118 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-da459948-2de1-4d59-b174-947c42be0149 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:14:16.086373 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-da459948-2de1-4d59-b174-947c42be0149 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c" status: 200 len: 1730 microversion: 2.20 time: 0.157697 Jun 07 22:14:16.086930 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 628/1277] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:14:15 2022] GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 22:14:17.104981 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-876d780c-6fc9-45c3-93ba-da1babe06192 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:14:17.105532 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-876d780c-6fc9-45c3-93ba-da1babe06192 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: cddfb0ad-63f6-4b0d-bf12-d388bfb0714c] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:14:17.112258 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-876d780c-6fc9-45c3-93ba-da1babe06192 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:17.113940 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-876d780c-6fc9-45c3-93ba-da1babe06192 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:17.114910 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-876d780c-6fc9-45c3-93ba-da1babe06192 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:17.115562 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-876d780c-6fc9-45c3-93ba-da1babe06192 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:17.254411 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-876d780c-6fc9-45c3-93ba-da1babe06192 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:14:17.262211 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-876d780c-6fc9-45c3-93ba-da1babe06192 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:14:17.263709 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-876d780c-6fc9-45c3-93ba-da1babe06192 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:14:17.264846 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-876d780c-6fc9-45c3-93ba-da1babe06192 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c" status: 200 len: 1730 microversion: 2.20 time: 0.163984 Jun 07 22:14:17.265396 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 650/1278] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:14:17 2022] GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:14:18.283818 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-c26e3a6a-b6ce-45c8-b0aa-96e26dbf55cd tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:14:18.284558 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-c26e3a6a-b6ce-45c8-b0aa-96e26dbf55cd tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: cddfb0ad-63f6-4b0d-bf12-d388bfb0714c] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:14:18.291158 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c26e3a6a-b6ce-45c8-b0aa-96e26dbf55cd tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:18.291677 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c26e3a6a-b6ce-45c8-b0aa-96e26dbf55cd tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:18.292439 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c26e3a6a-b6ce-45c8-b0aa-96e26dbf55cd tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:18.292875 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c26e3a6a-b6ce-45c8-b0aa-96e26dbf55cd tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:18.421169 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-c26e3a6a-b6ce-45c8-b0aa-96e26dbf55cd tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:14:18.429778 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-c26e3a6a-b6ce-45c8-b0aa-96e26dbf55cd tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:14:18.431279 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-c26e3a6a-b6ce-45c8-b0aa-96e26dbf55cd tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:14:18.432459 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-c26e3a6a-b6ce-45c8-b0aa-96e26dbf55cd tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c" status: 200 len: 1730 microversion: 2.20 time: 0.152580 Jun 07 22:14:18.433031 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 629/1279] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:14:18 2022] GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:14:19.179547 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [req-99ea114f-9892-4869-a281-eeb17f985d9d req-150e7043-ed5f-4ead-9efd-ad6a2f908ca5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cddfb0ad-63f6-4b0d-bf12-d388bfb0714c", "name": "network-vif-plugged", "status": "completed", "tag": "e1237eb4-3f3b-48bf-97bb-9e2c3cfc48b3"}]} {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:14:19.195744 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_api:SELECT=50 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:14:19.206525 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-99ea114f-9892-4869-a281-eeb17f985d9d req-150e7043-ed5f-4ead-9efd-ad6a2f908ca5 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:19.207136 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-99ea114f-9892-4869-a281-eeb17f985d9d req-150e7043-ed5f-4ead-9efd-ad6a2f908ca5 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:19.219905 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.compute.server_external_events [req-99ea114f-9892-4869-a281-eeb17f985d9d req-150e7043-ed5f-4ead-9efd-ad6a2f908ca5 service nova] Creating event network-vif-plugged:e1237eb4-3f3b-48bf-97bb-9e2c3cfc48b3 for instance cddfb0ad-63f6-4b0d-bf12-d388bfb0714c on hv-cinder-83552 Jun 07 22:14:19.230976 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [req-99ea114f-9892-4869-a281-eeb17f985d9d req-150e7043-ed5f-4ead-9efd-ad6a2f908ca5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125505 Jun 07 22:14:19.231591 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 651/1280] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:14:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:14:19.451188 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-3f78e499-349e-42fe-84df-dd98dff18163 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:14:19.451891 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-3f78e499-349e-42fe-84df-dd98dff18163 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: cddfb0ad-63f6-4b0d-bf12-d388bfb0714c] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:14:19.460838 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-3f78e499-349e-42fe-84df-dd98dff18163 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:19.461486 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-3f78e499-349e-42fe-84df-dd98dff18163 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:19.462526 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-3f78e499-349e-42fe-84df-dd98dff18163 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:19.463051 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-3f78e499-349e-42fe-84df-dd98dff18163 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:19.716945 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-3f78e499-349e-42fe-84df-dd98dff18163 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:14:19.725615 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-3f78e499-349e-42fe-84df-dd98dff18163 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:14:19.727153 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-3f78e499-349e-42fe-84df-dd98dff18163 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:14:19.728595 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-3f78e499-349e-42fe-84df-dd98dff18163 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c" status: 200 len: 1730 microversion: 2.20 time: 0.282410 Jun 07 22:14:19.729158 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 630/1281] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:14:19 2022] GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c => generated 1730 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:14:20.747144 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-77fb87e4-eb0a-4511-bf76-b346b7f5d21f tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:14:20.747868 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-77fb87e4-eb0a-4511-bf76-b346b7f5d21f tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: cddfb0ad-63f6-4b0d-bf12-d388bfb0714c] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:14:20.754682 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-77fb87e4-eb0a-4511-bf76-b346b7f5d21f tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:20.755139 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-77fb87e4-eb0a-4511-bf76-b346b7f5d21f tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:20.755972 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-77fb87e4-eb0a-4511-bf76-b346b7f5d21f tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:20.756408 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-77fb87e4-eb0a-4511-bf76-b346b7f5d21f tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:20.887059 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-77fb87e4-eb0a-4511-bf76-b346b7f5d21f tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:14:20.896305 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-77fb87e4-eb0a-4511-bf76-b346b7f5d21f tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:14:20.897815 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-77fb87e4-eb0a-4511-bf76-b346b7f5d21f tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:14:20.898973 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-77fb87e4-eb0a-4511-bf76-b346b7f5d21f tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c" status: 200 len: 1730 microversion: 2.20 time: 0.156689 Jun 07 22:14:20.899565 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 652/1282] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:14:20 2022] GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:14:21.917398 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-01578788-5c15-4523-8084-096a02973ba6 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:14:21.918572 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-01578788-5c15-4523-8084-096a02973ba6 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: cddfb0ad-63f6-4b0d-bf12-d388bfb0714c] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:14:21.926348 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-01578788-5c15-4523-8084-096a02973ba6 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:21.926792 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-01578788-5c15-4523-8084-096a02973ba6 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:21.927644 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-01578788-5c15-4523-8084-096a02973ba6 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:21.928006 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-01578788-5c15-4523-8084-096a02973ba6 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:22.063935 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-01578788-5c15-4523-8084-096a02973ba6 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:14:22.072133 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-01578788-5c15-4523-8084-096a02973ba6 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:14:22.073628 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-01578788-5c15-4523-8084-096a02973ba6 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:14:22.074791 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-01578788-5c15-4523-8084-096a02973ba6 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c" status: 200 len: 1730 microversion: 2.20 time: 0.161452 Jun 07 22:14:22.075424 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 631/1283] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:14:21 2022] GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:14:23.094136 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-02fdfdf3-839e-4662-a274-4d035c404132 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:14:23.094746 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-02fdfdf3-839e-4662-a274-4d035c404132 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: cddfb0ad-63f6-4b0d-bf12-d388bfb0714c] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:14:23.101871 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-02fdfdf3-839e-4662-a274-4d035c404132 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:23.102318 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-02fdfdf3-839e-4662-a274-4d035c404132 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:23.103348 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-02fdfdf3-839e-4662-a274-4d035c404132 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:23.103792 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-02fdfdf3-839e-4662-a274-4d035c404132 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:23.243937 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-02fdfdf3-839e-4662-a274-4d035c404132 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:14:23.252072 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-02fdfdf3-839e-4662-a274-4d035c404132 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:14:23.253726 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-02fdfdf3-839e-4662-a274-4d035c404132 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:14:23.254864 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-02fdfdf3-839e-4662-a274-4d035c404132 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c" status: 200 len: 1717 microversion: 2.20 time: 0.164774 Jun 07 22:14:23.255455 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 653/1284] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:14:23 2022] GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c => generated 1717 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 22:14:24.553767 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-4d7b8172-2711-411b-946c-9f9b34dc55b9 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:14:24.554688 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-4d7b8172-2711-411b-946c-9f9b34dc55b9 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: c00b6e50-3d0c-4614-bf39-f36ae4169292] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:14:24.561084 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4d7b8172-2711-411b-946c-9f9b34dc55b9 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:24.561523 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4d7b8172-2711-411b-946c-9f9b34dc55b9 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:24.562263 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4d7b8172-2711-411b-946c-9f9b34dc55b9 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:24.562689 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4d7b8172-2711-411b-946c-9f9b34dc55b9 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:24.591992 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-4d7b8172-2711-411b-946c-9f9b34dc55b9 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/c00b6e50-3d0c-4614-bf39-f36ae4169292/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042165 Jun 07 22:14:24.592538 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 632/1285] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jun 7 22:14:24 2022] GET /compute/v2.1/servers/c00b6e50-3d0c-4614-bf39-f36ae4169292/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:14:24.730023 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-ad8d7b2a-bca6-4911-83ca-301d8375dbf0 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:14:24.730539 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-ad8d7b2a-bca6-4911-83ca-301d8375dbf0 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: c00b6e50-3d0c-4614-bf39-f36ae4169292] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:14:24.737634 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ad8d7b2a-bca6-4911-83ca-301d8375dbf0 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:24.738076 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ad8d7b2a-bca6-4911-83ca-301d8375dbf0 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:24.738831 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ad8d7b2a-bca6-4911-83ca-301d8375dbf0 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:24.739255 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ad8d7b2a-bca6-4911-83ca-301d8375dbf0 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:24.767757 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-ad8d7b2a-bca6-4911-83ca-301d8375dbf0 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/c00b6e50-3d0c-4614-bf39-f36ae4169292/os-volume_attachments/1b9f52fc-1eab-459e-8d9c-ab139f0a15d3" status: 200 len: 194 microversion: 2.1 time: 0.042004 Jun 07 22:14:24.768339 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 654/1286] 10.222.0.13 () {58 vars in 1412 bytes} [Tue Jun 7 22:14:24 2022] GET /compute/v2.1/servers/c00b6e50-3d0c-4614-bf39-f36ae4169292/os-volume_attachments/1b9f52fc-1eab-459e-8d9c-ab139f0a15d3 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:14:24.777963 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-01b7b0a8-acfc-457f-8802-2e5b5fb925a6 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:14:24.778449 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-01b7b0a8-acfc-457f-8802-2e5b5fb925a6 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: c00b6e50-3d0c-4614-bf39-f36ae4169292] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:14:24.784379 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-01b7b0a8-acfc-457f-8802-2e5b5fb925a6 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:24.784819 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-01b7b0a8-acfc-457f-8802-2e5b5fb925a6 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:24.785567 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-01b7b0a8-acfc-457f-8802-2e5b5fb925a6 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:24.786000 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-01b7b0a8-acfc-457f-8802-2e5b5fb925a6 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:24.864347 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.objects.instance [None req-01b7b0a8-acfc-457f-8802-2e5b5fb925a6 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lazy-loading 'services' on Instance uuid c00b6e50-3d0c-4614-bf39-f36ae4169292 {{(pid=117970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 22:14:24.933619 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-01b7b0a8-acfc-457f-8802-2e5b5fb925a6 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "DELETE /compute/v2.1/servers/c00b6e50-3d0c-4614-bf39-f36ae4169292/os-volume_attachments/1b9f52fc-1eab-459e-8d9c-ab139f0a15d3" status: 202 len: 0 microversion: 2.1 time: 0.159425 Jun 07 22:14:24.934223 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 633/1287] 10.222.0.13 () {58 vars in 1415 bytes} [Tue Jun 7 22:14:24 2022] DELETE /compute/v2.1/servers/c00b6e50-3d0c-4614-bf39-f36ae4169292/os-volume_attachments/1b9f52fc-1eab-459e-8d9c-ab139f0a15d3 => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 22:14:26.669198 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-b4cd2681-b6bc-4d1c-9028-8341c34b346e tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:14:26.669754 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-b4cd2681-b6bc-4d1c-9028-8341c34b346e tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 994885ff-724e-44e8-8c8f-1150c334e1fe] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:14:26.676266 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b4cd2681-b6bc-4d1c-9028-8341c34b346e tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:26.676714 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b4cd2681-b6bc-4d1c-9028-8341c34b346e tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:26.677474 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b4cd2681-b6bc-4d1c-9028-8341c34b346e tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:26.677909 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b4cd2681-b6bc-4d1c-9028-8341c34b346e tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:26.700580 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-b4cd2681-b6bc-4d1c-9028-8341c34b346e tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/994885ff-724e-44e8-8c8f-1150c334e1fe/ips" status: 200 len: 151 microversion: 2.1 time: 0.035261 Jun 07 22:14:26.701070 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 655/1288] 10.222.0.13 () {58 vars in 1247 bytes} [Tue Jun 7 22:14:26 2022] GET /compute/v2.1/servers/994885ff-724e-44e8-8c8f-1150c334e1fe/ips => generated 151 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:14:27.095711 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-ce4bdd72-9e34-4e0a-a73b-2ba9aa4990dc tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:14:27.096294 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-ce4bdd72-9e34-4e0a-a73b-2ba9aa4990dc tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: c00b6e50-3d0c-4614-bf39-f36ae4169292] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:14:27.103678 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-ce4bdd72-9e34-4e0a-a73b-2ba9aa4990dc tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:27.104128 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-ce4bdd72-9e34-4e0a-a73b-2ba9aa4990dc tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:27.104886 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-ce4bdd72-9e34-4e0a-a73b-2ba9aa4990dc tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:27.105321 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-ce4bdd72-9e34-4e0a-a73b-2ba9aa4990dc tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:27.133190 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-ce4bdd72-9e34-4e0a-a73b-2ba9aa4990dc tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/c00b6e50-3d0c-4614-bf39-f36ae4169292/os-volume_attachments/e3433c7e-82c1-480f-b417-8b89817b433b" status: 200 len: 194 microversion: 2.1 time: 0.042449 Jun 07 22:14:27.133762 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 634/1289] 10.222.0.13 () {58 vars in 1412 bytes} [Tue Jun 7 22:14:27 2022] GET /compute/v2.1/servers/c00b6e50-3d0c-4614-bf39-f36ae4169292/os-volume_attachments/e3433c7e-82c1-480f-b417-8b89817b433b => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:14:27.143955 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-bb459fbf-9227-420a-acb6-796260c09cdb tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:14:27.144542 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-bb459fbf-9227-420a-acb6-796260c09cdb tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: c00b6e50-3d0c-4614-bf39-f36ae4169292] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:14:27.150452 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-bb459fbf-9227-420a-acb6-796260c09cdb tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:27.150898 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-bb459fbf-9227-420a-acb6-796260c09cdb tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:27.151670 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-bb459fbf-9227-420a-acb6-796260c09cdb tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:27.152098 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-bb459fbf-9227-420a-acb6-796260c09cdb tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:27.230713 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.objects.instance [None req-bb459fbf-9227-420a-acb6-796260c09cdb tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lazy-loading 'services' on Instance uuid c00b6e50-3d0c-4614-bf39-f36ae4169292 {{(pid=117971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 22:14:27.299313 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-bb459fbf-9227-420a-acb6-796260c09cdb tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "DELETE /compute/v2.1/servers/c00b6e50-3d0c-4614-bf39-f36ae4169292/os-volume_attachments/e3433c7e-82c1-480f-b417-8b89817b433b" status: 202 len: 0 microversion: 2.1 time: 0.159629 Jun 07 22:14:27.300566 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 656/1290] 10.222.0.13 () {58 vars in 1415 bytes} [Tue Jun 7 22:14:27 2022] DELETE /compute/v2.1/servers/c00b6e50-3d0c-4614-bf39-f36ae4169292/os-volume_attachments/e3433c7e-82c1-480f-b417-8b89817b433b => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 07 22:14:28.010452 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-108de9d2-fd8c-41fb-a30d-d6724bee528a tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "045436f3-3573-40a7-955a-f97a7495ff4a"}} {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:14:28.011522 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-108de9d2-fd8c-41fb-a30d-d6724bee528a tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 994885ff-724e-44e8-8c8f-1150c334e1fe] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:14:28.017383 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-108de9d2-fd8c-41fb-a30d-d6724bee528a tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:28.017827 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-108de9d2-fd8c-41fb-a30d-d6724bee528a tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:28.018574 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-108de9d2-fd8c-41fb-a30d-d6724bee528a tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:28.019003 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-108de9d2-fd8c-41fb-a30d-d6724bee528a tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:28.295415 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-108de9d2-fd8c-41fb-a30d-d6724bee528a tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "POST /compute/v2.1/servers/994885ff-724e-44e8-8c8f-1150c334e1fe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.288728 Jun 07 22:14:28.296153 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 635/1291] 10.222.0.13 () {60 vars in 1322 bytes} [Tue Jun 7 22:14:28 2022] POST /compute/v2.1/servers/994885ff-724e-44e8-8c8f-1150c334e1fe/os-volume_attachments => generated 194 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:14:28.458502 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-afc33721-4180-492c-a8e2-055c238bb065 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:14:28.459627 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-afc33721-4180-492c-a8e2-055c238bb065 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: c00b6e50-3d0c-4614-bf39-f36ae4169292] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:14:28.465847 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-afc33721-4180-492c-a8e2-055c238bb065 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:28.466303 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-afc33721-4180-492c-a8e2-055c238bb065 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:28.467067 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-afc33721-4180-492c-a8e2-055c238bb065 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:28.467533 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-afc33721-4180-492c-a8e2-055c238bb065 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:28.500367 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-afc33721-4180-492c-a8e2-055c238bb065 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/c00b6e50-3d0c-4614-bf39-f36ae4169292/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047090 Jun 07 22:14:28.500909 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 657/1292] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jun 7 22:14:28 2022] GET /compute/v2.1/servers/c00b6e50-3d0c-4614-bf39-f36ae4169292/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 07 22:14:28.610086 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-d4eaaba6-54f2-40c4-a42e-8e436640a516 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:14:28.611075 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-d4eaaba6-54f2-40c4-a42e-8e436640a516 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: c00b6e50-3d0c-4614-bf39-f36ae4169292] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:14:28.617414 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d4eaaba6-54f2-40c4-a42e-8e436640a516 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:28.617862 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d4eaaba6-54f2-40c4-a42e-8e436640a516 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:28.618608 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d4eaaba6-54f2-40c4-a42e-8e436640a516 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:28.619041 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d4eaaba6-54f2-40c4-a42e-8e436640a516 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:28.646949 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-d4eaaba6-54f2-40c4-a42e-8e436640a516 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/c00b6e50-3d0c-4614-bf39-f36ae4169292/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041613 Jun 07 22:14:28.647515 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 636/1293] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jun 7 22:14:28 2022] GET /compute/v2.1/servers/c00b6e50-3d0c-4614-bf39-f36ae4169292/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 07 22:14:28.702305 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-e110e514-0f80-40bc-b4bd-3e33933f3a76 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:14:28.702828 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-e110e514-0f80-40bc-b4bd-3e33933f3a76 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: c00b6e50-3d0c-4614-bf39-f36ae4169292] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:14:28.709615 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e110e514-0f80-40bc-b4bd-3e33933f3a76 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:28.710057 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e110e514-0f80-40bc-b4bd-3e33933f3a76 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:28.710811 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e110e514-0f80-40bc-b4bd-3e33933f3a76 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:28.711236 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e110e514-0f80-40bc-b4bd-3e33933f3a76 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:28.738703 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-e110e514-0f80-40bc-b4bd-3e33933f3a76 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: c00b6e50-3d0c-4614-bf39-f36ae4169292] Going to try to terminate instance {{(pid=117971) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 22:14:28.812272 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-e110e514-0f80-40bc-b4bd-3e33933f3a76 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "DELETE /compute/v2.1/servers/c00b6e50-3d0c-4614-bf39-f36ae4169292" status: 204 len: 0 microversion: 2.1 time: 0.113400 Jun 07 22:14:28.812910 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 658/1294] 10.222.0.13 () {58 vars in 1238 bytes} [Tue Jun 7 22:14:28 2022] DELETE /compute/v2.1/servers/c00b6e50-3d0c-4614-bf39-f36ae4169292 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 22:14:28.821443 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-86e7092f-8b18-4535-9199-ec82b6f53b28 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:14:28.822048 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-86e7092f-8b18-4535-9199-ec82b6f53b28 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: c00b6e50-3d0c-4614-bf39-f36ae4169292] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:14:28.830622 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-86e7092f-8b18-4535-9199-ec82b6f53b28 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:28.831851 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-86e7092f-8b18-4535-9199-ec82b6f53b28 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:28.832817 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-86e7092f-8b18-4535-9199-ec82b6f53b28 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:28.833247 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-86e7092f-8b18-4535-9199-ec82b6f53b28 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:28.963489 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-86e7092f-8b18-4535-9199-ec82b6f53b28 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:14:28.971352 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-86e7092f-8b18-4535-9199-ec82b6f53b28 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/c00b6e50-3d0c-4614-bf39-f36ae4169292" status: 200 len: 1671 microversion: 2.1 time: 0.153879 Jun 07 22:14:28.972006 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 637/1295] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:14:28 2022] GET /compute/v2.1/servers/c00b6e50-3d0c-4614-bf39-f36ae4169292 => generated 1671 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:14:29.990633 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-510a1165-7acd-434a-b97d-73ae5e5e9c2e tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:14:29.991340 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-510a1165-7acd-434a-b97d-73ae5e5e9c2e tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: c00b6e50-3d0c-4614-bf39-f36ae4169292] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:14:29.997683 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-510a1165-7acd-434a-b97d-73ae5e5e9c2e tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:29.998123 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-510a1165-7acd-434a-b97d-73ae5e5e9c2e tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:29.998866 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-510a1165-7acd-434a-b97d-73ae5e5e9c2e tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:29.999293 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-510a1165-7acd-434a-b97d-73ae5e5e9c2e tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:30.125852 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-510a1165-7acd-434a-b97d-73ae5e5e9c2e tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:14:30.133494 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-510a1165-7acd-434a-b97d-73ae5e5e9c2e tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/c00b6e50-3d0c-4614-bf39-f36ae4169292" status: 200 len: 1671 microversion: 2.1 time: 0.147228 Jun 07 22:14:30.134050 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 659/1296] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:14:29 2022] GET /compute/v2.1/servers/c00b6e50-3d0c-4614-bf39-f36ae4169292 => generated 1671 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:14:31.150039 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-4fdaf8c1-2423-476f-b92b-d69e7ecd8ea2 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:14:31.150644 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-4fdaf8c1-2423-476f-b92b-d69e7ecd8ea2 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: c00b6e50-3d0c-4614-bf39-f36ae4169292] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:14:31.157235 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4fdaf8c1-2423-476f-b92b-d69e7ecd8ea2 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:31.157681 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4fdaf8c1-2423-476f-b92b-d69e7ecd8ea2 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:31.158434 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4fdaf8c1-2423-476f-b92b-d69e7ecd8ea2 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:31.159390 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4fdaf8c1-2423-476f-b92b-d69e7ecd8ea2 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:31.363235 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-4fdaf8c1-2423-476f-b92b-d69e7ecd8ea2 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:14:31.370744 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-4fdaf8c1-2423-476f-b92b-d69e7ecd8ea2 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/c00b6e50-3d0c-4614-bf39-f36ae4169292" status: 200 len: 1671 microversion: 2.1 time: 0.224517 Jun 07 22:14:31.372046 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 638/1297] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:14:31 2022] GET /compute/v2.1/servers/c00b6e50-3d0c-4614-bf39-f36ae4169292 => generated 1671 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:14:32.093927 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [req-15ff104f-31d1-4b2c-b82e-6e257609d4ff req-5ea71137-2b06-4da3-a643-6ae581917a6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c00b6e50-3d0c-4614-bf39-f36ae4169292", "name": "network-vif-deleted", "tag": "866c9fb2-9a6c-4731-b04c-3aa4fcb01a21"}]} {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:14:32.105234 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-15ff104f-31d1-4b2c-b82e-6e257609d4ff req-5ea71137-2b06-4da3-a643-6ae581917a6d service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:32.105773 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-15ff104f-31d1-4b2c-b82e-6e257609d4ff req-5ea71137-2b06-4da3-a643-6ae581917a6d service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:32.118070 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.compute.server_external_events [req-15ff104f-31d1-4b2c-b82e-6e257609d4ff req-5ea71137-2b06-4da3-a643-6ae581917a6d service nova] Creating event network-vif-deleted:866c9fb2-9a6c-4731-b04c-3aa4fcb01a21 for instance c00b6e50-3d0c-4614-bf39-f36ae4169292 on hv-cinder-83552 Jun 07 22:14:32.124079 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [req-15ff104f-31d1-4b2c-b82e-6e257609d4ff req-5ea71137-2b06-4da3-a643-6ae581917a6d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033579 Jun 07 22:14:32.125021 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 660/1298] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:14:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:14:32.388429 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-f0b70ee2-022d-4d8f-9e02-4a03635f7a92 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:14:32.389131 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-f0b70ee2-022d-4d8f-9e02-4a03635f7a92 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: c00b6e50-3d0c-4614-bf39-f36ae4169292] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:14:32.396457 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f0b70ee2-022d-4d8f-9e02-4a03635f7a92 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:32.396782 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f0b70ee2-022d-4d8f-9e02-4a03635f7a92 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:32.397549 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f0b70ee2-022d-4d8f-9e02-4a03635f7a92 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:32.397979 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f0b70ee2-022d-4d8f-9e02-4a03635f7a92 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:32.436590 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f0b70ee2-022d-4d8f-9e02-4a03635f7a92 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:32.437034 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f0b70ee2-022d-4d8f-9e02-4a03635f7a92 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:32.437489 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.objects.instance [None req-f0b70ee2-022d-4d8f-9e02-4a03635f7a92 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lazy-loading 'fault' on Instance uuid c00b6e50-3d0c-4614-bf39-f36ae4169292 {{(pid=117970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 22:14:32.484865 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-f0b70ee2-022d-4d8f-9e02-4a03635f7a92 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e68eff6a08d4193b3167d47f4e1f97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f58b7303541388483ca4b881a552e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:14:32.493248 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-f0b70ee2-022d-4d8f-9e02-4a03635f7a92 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/c00b6e50-3d0c-4614-bf39-f36ae4169292" status: 200 len: 1326 microversion: 2.1 time: 0.108831 Jun 07 22:14:32.493825 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 639/1299] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:14:32 2022] GET /compute/v2.1/servers/c00b6e50-3d0c-4614-bf39-f36ae4169292 => generated 1326 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:14:33.510512 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-c8540826-a67d-40c5-b3fc-e69f8e17f528 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:14:33.511129 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-c8540826-a67d-40c5-b3fc-e69f8e17f528 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: c00b6e50-3d0c-4614-bf39-f36ae4169292] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:14:33.517802 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c8540826-a67d-40c5-b3fc-e69f8e17f528 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:33.518858 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c8540826-a67d-40c5-b3fc-e69f8e17f528 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:33.519639 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c8540826-a67d-40c5-b3fc-e69f8e17f528 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:33.520076 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c8540826-a67d-40c5-b3fc-e69f8e17f528 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:33.533024 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.wsgi [None req-c8540826-a67d-40c5-b3fc-e69f8e17f528 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] HTTP exception thrown: Instance c00b6e50-3d0c-4614-bf39-f36ae4169292 could not be found. Jun 07 22:14:33.534620 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-c8540826-a67d-40c5-b3fc-e69f8e17f528 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Request method failure captured: Jun 07 22:14:33.534620 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: request: GET /compute/v2.1/servers/c00b6e50-3d0c-4614-bf39-f36ae4169292 HTTP/1.1 Jun 07 22:14:33.534620 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Accept: application/json Jun 07 22:14:33.534620 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Accept-Encoding: identity Jun 07 22:14:33.534620 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Connection: close Jun 07 22:14:33.534620 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Content-Length: 0 Jun 07 22:14:33.534620 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Content-Type: application/json Jun 07 22:14:33.534620 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Host: 10.222.0.13 Jun 07 22:14:33.534620 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Openstack-System-Scope: None Jun 07 22:14:33.534620 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: User-Agent: python-urllib3/1.26.9 Jun 07 22:14:33.534620 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Auth-Token: gAAAAABin8stFnSMxrhT84EXIXg15dNZm3Gd2ykjx38HfSUx0lJsugvPTyPdpw3Tz6k88_OYtoshuwGwdqYNoYAViMeGgt0DiBqvlGNzpOWfMHV1_871Sx-8V9C-sw_a6H3vbGtS3KWJgFbLpzr_Hma8mRUqSKW5EPbeOn9lfv_84fRIgRu2c_4 Jun 07 22:14:33.534620 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Domain-Id: None Jun 07 22:14:33.534620 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Domain-Name: None Jun 07 22:14:33.534620 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Identity-Status: Confirmed Jun 07 22:14:33.534620 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Is-Admin-Project: True Jun 07 22:14:33.534620 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Domain-Id: default Jun 07 22:14:33.534620 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Domain-Name: Default Jun 07 22:14:33.534620 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Id: d32f58b7303541388483ca4b881a552e Jun 07 22:14:33.534620 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Name: tempest-AttachVolumeTestJSON-1459522994 Jun 07 22:14:33.534620 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Role: member,reader Jun 07 22:14:33.534620 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Roles: member,reader Jun 07 22:14:33.536141 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d32f58b7303541388483ca4b881a552e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_d32f58b7303541388483ca4b881a552e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d32f58b7303541388483ca4b881a552e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/d32f58b7303541388483ca4b881a552e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}] Jun 07 22:14:33.536141 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant: tempest-AttachVolumeTestJSON-1459522994 Jun 07 22:14:33.536141 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant-Id: d32f58b7303541388483ca4b881a552e Jun 07 22:14:33.536141 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1459522994 Jun 07 22:14:33.536141 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User: tempest-AttachVolumeTestJSON-1459522994-project Jun 07 22:14:33.536141 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Domain-Id: default Jun 07 22:14:33.536141 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Domain-Name: Default Jun 07 22:14:33.536141 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Id: 0e68eff6a08d4193b3167d47f4e1f97c Jun 07 22:14:33.536141 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Name: tempest-AttachVolumeTestJSON-1459522994-project Jun 07 22:14:33.536141 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: method: > Jun 07 22:14:33.536141 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: exception: Instance c00b6e50-3d0c-4614-bf39-f36ae4169292 could not be found. Jun 07 22:14:33.536141 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: action_args: {'id': 'c00b6e50-3d0c-4614-bf39-f36ae4169292'} Jun 07 22:14:33.536956 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 22:14:33.536956 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:14:33.536956 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 22:14:33.536956 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 22:14:33.536956 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 22:14:33.536956 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 22:14:33.536956 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 22:14:33.536956 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 22:14:33.536956 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 22:14:33.536956 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 22:14:33.536956 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c00b6e50-3d0c-4614-bf39-f36ae4169292 could not be found. Jun 07 22:14:33.536956 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:14:33.536956 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:14:33.536956 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:14:33.536956 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:14:33.536956 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:14:33.536956 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:14:33.536956 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 22:14:33.536956 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 22:14:33.536956 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 22:14:33.538657 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 22:14:33.538657 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 22:14:33.538657 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 22:14:33.538657 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 22:14:33.538657 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 22:14:33.538657 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 22:14:33.538657 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 22:14:33.538657 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c00b6e50-3d0c-4614-bf39-f36ae4169292 could not be found. Jun 07 22:14:33.538657 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:14:33.538657 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:14:33.538657 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:14:33.538657 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:14:33.538657 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:14:33.538657 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:14:33.538657 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 22:14:33.538657 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 22:14:33.538657 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c00b6e50-3d0c-4614-bf39-f36ae4169292 could not be found. Jun 07 22:14:33.538657 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:14:33.541500 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-c8540826-a67d-40c5-b3fc-e69f8e17f528 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Returning 404 to user: Instance c00b6e50-3d0c-4614-bf39-f36ae4169292 could not be found. {{(pid=117971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 22:14:33.541500 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-c8540826-a67d-40c5-b3fc-e69f8e17f528 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/c00b6e50-3d0c-4614-bf39-f36ae4169292" status: 404 len: 111 microversion: 2.1 time: 0.029888 Jun 07 22:14:33.541500 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 661/1300] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:14:33 2022] GET /compute/v2.1/servers/c00b6e50-3d0c-4614-bf39-f36ae4169292 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 22:14:33.544894 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-3338a15f-2d70-4143-8762-63e28ea4d027 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '.version_select at 0x7f92f0ff9a60>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:14:33.574962 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-3338a15f-2d70-4143-8762-63e28ea4d027 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-329874958" status: 202 len: 0 microversion: 2.1 time: 0.033719 Jun 07 22:14:33.575627 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 640/1301] 10.222.0.13 () {58 vars in 1217 bytes} [Tue Jun 7 22:14:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-329874958 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 22:14:36.434853 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-6f1e9c35-539d-4bd2-9fe4-98244ee09997 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:14:36.435493 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-6f1e9c35-539d-4bd2-9fe4-98244ee09997 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: c00b6e50-3d0c-4614-bf39-f36ae4169292] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:14:36.442032 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-6f1e9c35-539d-4bd2-9fe4-98244ee09997 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:36.442483 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-6f1e9c35-539d-4bd2-9fe4-98244ee09997 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:36.443243 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-6f1e9c35-539d-4bd2-9fe4-98244ee09997 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:36.443706 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-6f1e9c35-539d-4bd2-9fe4-98244ee09997 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:36.457431 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.wsgi [None req-6f1e9c35-539d-4bd2-9fe4-98244ee09997 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] HTTP exception thrown: Instance c00b6e50-3d0c-4614-bf39-f36ae4169292 could not be found. Jun 07 22:14:36.458943 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-6f1e9c35-539d-4bd2-9fe4-98244ee09997 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Request method failure captured: Jun 07 22:14:36.458943 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: request: DELETE /compute/v2.1/servers/c00b6e50-3d0c-4614-bf39-f36ae4169292 HTTP/1.1 Jun 07 22:14:36.458943 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Accept: application/json Jun 07 22:14:36.458943 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Accept-Encoding: identity Jun 07 22:14:36.458943 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Connection: close Jun 07 22:14:36.458943 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Content-Length: 0 Jun 07 22:14:36.458943 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Content-Type: application/json Jun 07 22:14:36.458943 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Host: 10.222.0.13 Jun 07 22:14:36.458943 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Openstack-System-Scope: None Jun 07 22:14:36.458943 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: User-Agent: python-urllib3/1.26.9 Jun 07 22:14:36.458943 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Auth-Token: gAAAAABin8stFnSMxrhT84EXIXg15dNZm3Gd2ykjx38HfSUx0lJsugvPTyPdpw3Tz6k88_OYtoshuwGwdqYNoYAViMeGgt0DiBqvlGNzpOWfMHV1_871Sx-8V9C-sw_a6H3vbGtS3KWJgFbLpzr_Hma8mRUqSKW5EPbeOn9lfv_84fRIgRu2c_4 Jun 07 22:14:36.458943 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Domain-Id: None Jun 07 22:14:36.458943 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Domain-Name: None Jun 07 22:14:36.458943 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Identity-Status: Confirmed Jun 07 22:14:36.458943 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Is-Admin-Project: True Jun 07 22:14:36.458943 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Domain-Id: default Jun 07 22:14:36.458943 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Domain-Name: Default Jun 07 22:14:36.458943 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Id: d32f58b7303541388483ca4b881a552e Jun 07 22:14:36.458943 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Name: tempest-AttachVolumeTestJSON-1459522994 Jun 07 22:14:36.458943 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Role: member,reader Jun 07 22:14:36.458943 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Roles: member,reader Jun 07 22:14:36.460564 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d32f58b7303541388483ca4b881a552e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_d32f58b7303541388483ca4b881a552e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d32f58b7303541388483ca4b881a552e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/d32f58b7303541388483ca4b881a552e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}] Jun 07 22:14:36.460564 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant: tempest-AttachVolumeTestJSON-1459522994 Jun 07 22:14:36.460564 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant-Id: d32f58b7303541388483ca4b881a552e Jun 07 22:14:36.460564 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1459522994 Jun 07 22:14:36.460564 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User: tempest-AttachVolumeTestJSON-1459522994-project Jun 07 22:14:36.460564 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Domain-Id: default Jun 07 22:14:36.460564 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Domain-Name: Default Jun 07 22:14:36.460564 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Id: 0e68eff6a08d4193b3167d47f4e1f97c Jun 07 22:14:36.460564 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Name: tempest-AttachVolumeTestJSON-1459522994-project Jun 07 22:14:36.460564 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: method: > Jun 07 22:14:36.460564 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: exception: Instance c00b6e50-3d0c-4614-bf39-f36ae4169292 could not be found. Jun 07 22:14:36.460564 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: action_args: {'id': 'c00b6e50-3d0c-4614-bf39-f36ae4169292'} Jun 07 22:14:36.461444 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 22:14:36.461444 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:14:36.461444 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 22:14:36.461444 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 22:14:36.461444 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 22:14:36.461444 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 22:14:36.461444 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 22:14:36.461444 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 22:14:36.461444 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 22:14:36.461444 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 22:14:36.461444 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c00b6e50-3d0c-4614-bf39-f36ae4169292 could not be found. Jun 07 22:14:36.461444 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:14:36.461444 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:14:36.461444 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:14:36.461444 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:14:36.461444 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:14:36.461444 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:14:36.461444 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 22:14:36.461444 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 22:14:36.461444 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 22:14:36.462748 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 22:14:36.462748 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 22:14:36.462748 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 22:14:36.462748 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 22:14:36.462748 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 22:14:36.462748 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 22:14:36.462748 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 22:14:36.462748 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 22:14:36.462748 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 22:14:36.462748 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c00b6e50-3d0c-4614-bf39-f36ae4169292 could not be found. Jun 07 22:14:36.462748 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:14:36.462748 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:14:36.462748 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:14:36.462748 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:14:36.462748 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:14:36.462748 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:14:36.462748 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 22:14:36.462748 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 22:14:36.462748 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c00b6e50-3d0c-4614-bf39-f36ae4169292 could not be found. Jun 07 22:14:36.462748 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:14:36.464024 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-6f1e9c35-539d-4bd2-9fe4-98244ee09997 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Returning 404 to user: Instance c00b6e50-3d0c-4614-bf39-f36ae4169292 could not be found. {{(pid=117971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 22:14:36.464024 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-6f1e9c35-539d-4bd2-9fe4-98244ee09997 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "DELETE /compute/v2.1/servers/c00b6e50-3d0c-4614-bf39-f36ae4169292" status: 404 len: 111 microversion: 2.1 time: 0.029482 Jun 07 22:14:36.464024 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 662/1302] 10.222.0.13 () {58 vars in 1238 bytes} [Tue Jun 7 22:14:36 2022] DELETE /compute/v2.1/servers/c00b6e50-3d0c-4614-bf39-f36ae4169292 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 22:14:36.468715 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-4cc2345a-cb0a-44a0-8e36-18c5b13a0064 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:14:36.469325 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-4cc2345a-cb0a-44a0-8e36-18c5b13a0064 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: c00b6e50-3d0c-4614-bf39-f36ae4169292] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:14:36.476349 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4cc2345a-cb0a-44a0-8e36-18c5b13a0064 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:36.476794 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4cc2345a-cb0a-44a0-8e36-18c5b13a0064 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:36.477540 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4cc2345a-cb0a-44a0-8e36-18c5b13a0064 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:36.478216 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4cc2345a-cb0a-44a0-8e36-18c5b13a0064 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:36.491010 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.wsgi [None req-4cc2345a-cb0a-44a0-8e36-18c5b13a0064 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] HTTP exception thrown: Instance c00b6e50-3d0c-4614-bf39-f36ae4169292 could not be found. Jun 07 22:14:36.492651 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-4cc2345a-cb0a-44a0-8e36-18c5b13a0064 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Request method failure captured: Jun 07 22:14:36.492651 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: request: GET /compute/v2.1/servers/c00b6e50-3d0c-4614-bf39-f36ae4169292 HTTP/1.1 Jun 07 22:14:36.492651 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Accept: application/json Jun 07 22:14:36.492651 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Accept-Encoding: identity Jun 07 22:14:36.492651 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Connection: close Jun 07 22:14:36.492651 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Content-Length: 0 Jun 07 22:14:36.492651 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Content-Type: application/json Jun 07 22:14:36.492651 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Host: 10.222.0.13 Jun 07 22:14:36.492651 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Openstack-System-Scope: None Jun 07 22:14:36.492651 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: User-Agent: python-urllib3/1.26.9 Jun 07 22:14:36.492651 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Auth-Token: gAAAAABin8stFnSMxrhT84EXIXg15dNZm3Gd2ykjx38HfSUx0lJsugvPTyPdpw3Tz6k88_OYtoshuwGwdqYNoYAViMeGgt0DiBqvlGNzpOWfMHV1_871Sx-8V9C-sw_a6H3vbGtS3KWJgFbLpzr_Hma8mRUqSKW5EPbeOn9lfv_84fRIgRu2c_4 Jun 07 22:14:36.492651 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Domain-Id: None Jun 07 22:14:36.492651 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Domain-Name: None Jun 07 22:14:36.492651 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Identity-Status: Confirmed Jun 07 22:14:36.492651 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Is-Admin-Project: True Jun 07 22:14:36.492651 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Domain-Id: default Jun 07 22:14:36.492651 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Domain-Name: Default Jun 07 22:14:36.492651 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Id: d32f58b7303541388483ca4b881a552e Jun 07 22:14:36.492651 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Name: tempest-AttachVolumeTestJSON-1459522994 Jun 07 22:14:36.492651 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Role: member,reader Jun 07 22:14:36.492651 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Roles: member,reader Jun 07 22:14:36.494590 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d32f58b7303541388483ca4b881a552e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_d32f58b7303541388483ca4b881a552e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d32f58b7303541388483ca4b881a552e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/d32f58b7303541388483ca4b881a552e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}] Jun 07 22:14:36.494590 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Tenant: tempest-AttachVolumeTestJSON-1459522994 Jun 07 22:14:36.494590 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Tenant-Id: d32f58b7303541388483ca4b881a552e Jun 07 22:14:36.494590 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1459522994 Jun 07 22:14:36.494590 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User: tempest-AttachVolumeTestJSON-1459522994-project Jun 07 22:14:36.494590 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Domain-Id: default Jun 07 22:14:36.494590 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Domain-Name: Default Jun 07 22:14:36.494590 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Id: 0e68eff6a08d4193b3167d47f4e1f97c Jun 07 22:14:36.494590 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Name: tempest-AttachVolumeTestJSON-1459522994-project Jun 07 22:14:36.494590 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: method: > Jun 07 22:14:36.494590 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: exception: Instance c00b6e50-3d0c-4614-bf39-f36ae4169292 could not be found. Jun 07 22:14:36.494590 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: action_args: {'id': 'c00b6e50-3d0c-4614-bf39-f36ae4169292'} Jun 07 22:14:36.495632 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 22:14:36.495632 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:14:36.495632 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 22:14:36.495632 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 22:14:36.495632 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 22:14:36.495632 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 22:14:36.495632 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 22:14:36.495632 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 22:14:36.495632 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 22:14:36.495632 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 22:14:36.495632 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c00b6e50-3d0c-4614-bf39-f36ae4169292 could not be found. Jun 07 22:14:36.495632 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:14:36.495632 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:14:36.495632 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:14:36.495632 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:14:36.495632 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:14:36.495632 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:14:36.495632 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 22:14:36.495632 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 22:14:36.495632 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 22:14:36.497224 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 22:14:36.497224 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 22:14:36.497224 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 22:14:36.497224 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 22:14:36.497224 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 22:14:36.497224 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 22:14:36.497224 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 22:14:36.497224 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c00b6e50-3d0c-4614-bf39-f36ae4169292 could not be found. Jun 07 22:14:36.497224 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:14:36.497224 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:14:36.497224 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:14:36.497224 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:14:36.497224 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:14:36.497224 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:14:36.497224 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 22:14:36.497224 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 22:14:36.497224 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c00b6e50-3d0c-4614-bf39-f36ae4169292 could not be found. Jun 07 22:14:36.497224 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:14:36.498505 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-4cc2345a-cb0a-44a0-8e36-18c5b13a0064 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Returning 404 to user: Instance c00b6e50-3d0c-4614-bf39-f36ae4169292 could not be found. {{(pid=117970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 22:14:36.498505 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-4cc2345a-cb0a-44a0-8e36-18c5b13a0064 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/c00b6e50-3d0c-4614-bf39-f36ae4169292" status: 404 len: 111 microversion: 2.1 time: 0.029129 Jun 07 22:14:36.498505 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 641/1303] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:14:36 2022] GET /compute/v2.1/servers/c00b6e50-3d0c-4614-bf39-f36ae4169292 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 22:14:37.627032 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-7ffd2a65-a2b3-42d4-80a4-fb0b48ab0785 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:14:37.628145 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-7ffd2a65-a2b3-42d4-80a4-fb0b48ab0785 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:14:37.634543 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-7ffd2a65-a2b3-42d4-80a4-fb0b48ab0785 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:37.634985 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-7ffd2a65-a2b3-42d4-80a4-fb0b48ab0785 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:37.635766 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-7ffd2a65-a2b3-42d4-80a4-fb0b48ab0785 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:37.636225 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-7ffd2a65-a2b3-42d4-80a4-fb0b48ab0785 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:37.650232 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.wsgi [None req-7ffd2a65-a2b3-42d4-80a4-fb0b48ab0785 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] HTTP exception thrown: Instance f29be694-507c-48eb-9fdd-d20bef8f6609 could not be found. Jun 07 22:14:37.651759 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-7ffd2a65-a2b3-42d4-80a4-fb0b48ab0785 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Request method failure captured: Jun 07 22:14:37.651759 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: request: DELETE /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 HTTP/1.1 Jun 07 22:14:37.651759 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Accept: application/json Jun 07 22:14:37.651759 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Accept-Encoding: identity Jun 07 22:14:37.651759 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Connection: close Jun 07 22:14:37.651759 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Content-Length: 0 Jun 07 22:14:37.651759 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Content-Type: application/json Jun 07 22:14:37.651759 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Host: 10.222.0.13 Jun 07 22:14:37.651759 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Openstack-System-Scope: None Jun 07 22:14:37.651759 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: User-Agent: python-urllib3/1.26.9 Jun 07 22:14:37.651759 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Auth-Token: gAAAAABin8stFnSMxrhT84EXIXg15dNZm3Gd2ykjx38HfSUx0lJsugvPTyPdpw3Tz6k88_OYtoshuwGwdqYNoYAViMeGgt0DiBqvlGNzpOWfMHV1_871Sx-8V9C-sw_a6H3vbGtS3KWJgFbLpzr_Hma8mRUqSKW5EPbeOn9lfv_84fRIgRu2c_4 Jun 07 22:14:37.651759 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Domain-Id: None Jun 07 22:14:37.651759 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Domain-Name: None Jun 07 22:14:37.651759 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Identity-Status: Confirmed Jun 07 22:14:37.651759 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Is-Admin-Project: True Jun 07 22:14:37.651759 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Domain-Id: default Jun 07 22:14:37.651759 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Domain-Name: Default Jun 07 22:14:37.651759 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Id: d32f58b7303541388483ca4b881a552e Jun 07 22:14:37.651759 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Name: tempest-AttachVolumeTestJSON-1459522994 Jun 07 22:14:37.651759 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Role: member,reader Jun 07 22:14:37.651759 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Roles: member,reader Jun 07 22:14:37.653368 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d32f58b7303541388483ca4b881a552e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_d32f58b7303541388483ca4b881a552e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d32f58b7303541388483ca4b881a552e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/d32f58b7303541388483ca4b881a552e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}] Jun 07 22:14:37.653368 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant: tempest-AttachVolumeTestJSON-1459522994 Jun 07 22:14:37.653368 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant-Id: d32f58b7303541388483ca4b881a552e Jun 07 22:14:37.653368 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1459522994 Jun 07 22:14:37.653368 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User: tempest-AttachVolumeTestJSON-1459522994-project Jun 07 22:14:37.653368 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Domain-Id: default Jun 07 22:14:37.653368 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Domain-Name: Default Jun 07 22:14:37.653368 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Id: 0e68eff6a08d4193b3167d47f4e1f97c Jun 07 22:14:37.653368 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Name: tempest-AttachVolumeTestJSON-1459522994-project Jun 07 22:14:37.653368 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: method: > Jun 07 22:14:37.653368 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: exception: Instance f29be694-507c-48eb-9fdd-d20bef8f6609 could not be found. Jun 07 22:14:37.653368 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: action_args: {'id': 'f29be694-507c-48eb-9fdd-d20bef8f6609'} Jun 07 22:14:37.654486 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 22:14:37.654486 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:14:37.654486 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 22:14:37.654486 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 22:14:37.654486 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 22:14:37.654486 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 22:14:37.654486 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 22:14:37.654486 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 22:14:37.654486 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 22:14:37.654486 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 22:14:37.654486 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f29be694-507c-48eb-9fdd-d20bef8f6609 could not be found. Jun 07 22:14:37.654486 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:14:37.654486 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:14:37.654486 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:14:37.654486 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:14:37.654486 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:14:37.654486 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:14:37.654486 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 22:14:37.654486 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 22:14:37.654486 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 22:14:37.656030 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 22:14:37.656030 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 22:14:37.656030 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 22:14:37.656030 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 22:14:37.656030 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 22:14:37.656030 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 22:14:37.656030 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 22:14:37.656030 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 22:14:37.656030 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 22:14:37.656030 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f29be694-507c-48eb-9fdd-d20bef8f6609 could not be found. Jun 07 22:14:37.656030 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:14:37.656030 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:14:37.656030 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:14:37.656030 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:14:37.656030 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:14:37.656030 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:14:37.656030 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 22:14:37.656030 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 22:14:37.656030 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f29be694-507c-48eb-9fdd-d20bef8f6609 could not be found. Jun 07 22:14:37.656030 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:14:37.657614 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-7ffd2a65-a2b3-42d4-80a4-fb0b48ab0785 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Returning 404 to user: Instance f29be694-507c-48eb-9fdd-d20bef8f6609 could not be found. {{(pid=117971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 22:14:37.657614 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-7ffd2a65-a2b3-42d4-80a4-fb0b48ab0785 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 404 len: 111 microversion: 2.1 time: 0.029928 Jun 07 22:14:37.657614 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 663/1304] 10.222.0.13 () {58 vars in 1238 bytes} [Tue Jun 7 22:14:37 2022] DELETE /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 22:14:37.662134 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-e7583048-a0cf-4ba5-8444-c1fa8baa0b32 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:14:37.662748 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-e7583048-a0cf-4ba5-8444-c1fa8baa0b32 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] [instance: f29be694-507c-48eb-9fdd-d20bef8f6609] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:14:37.665293 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_api:SELECT=32,nova_api:DELETE=1 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:14:37.670492 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e7583048-a0cf-4ba5-8444-c1fa8baa0b32 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:37.670943 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e7583048-a0cf-4ba5-8444-c1fa8baa0b32 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:37.671741 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e7583048-a0cf-4ba5-8444-c1fa8baa0b32 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:37.672182 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e7583048-a0cf-4ba5-8444-c1fa8baa0b32 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:37.677117 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:14:37.687412 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.wsgi [None req-e7583048-a0cf-4ba5-8444-c1fa8baa0b32 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] HTTP exception thrown: Instance f29be694-507c-48eb-9fdd-d20bef8f6609 could not be found. Jun 07 22:14:37.689104 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-e7583048-a0cf-4ba5-8444-c1fa8baa0b32 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Request method failure captured: Jun 07 22:14:37.689104 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: request: GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 HTTP/1.1 Jun 07 22:14:37.689104 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Accept: application/json Jun 07 22:14:37.689104 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Accept-Encoding: identity Jun 07 22:14:37.689104 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Connection: close Jun 07 22:14:37.689104 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Content-Length: 0 Jun 07 22:14:37.689104 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Content-Type: application/json Jun 07 22:14:37.689104 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Host: 10.222.0.13 Jun 07 22:14:37.689104 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Openstack-System-Scope: None Jun 07 22:14:37.689104 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: User-Agent: python-urllib3/1.26.9 Jun 07 22:14:37.689104 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Auth-Token: gAAAAABin8stFnSMxrhT84EXIXg15dNZm3Gd2ykjx38HfSUx0lJsugvPTyPdpw3Tz6k88_OYtoshuwGwdqYNoYAViMeGgt0DiBqvlGNzpOWfMHV1_871Sx-8V9C-sw_a6H3vbGtS3KWJgFbLpzr_Hma8mRUqSKW5EPbeOn9lfv_84fRIgRu2c_4 Jun 07 22:14:37.689104 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Domain-Id: None Jun 07 22:14:37.689104 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Domain-Name: None Jun 07 22:14:37.689104 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Identity-Status: Confirmed Jun 07 22:14:37.689104 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Is-Admin-Project: True Jun 07 22:14:37.689104 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Domain-Id: default Jun 07 22:14:37.689104 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Domain-Name: Default Jun 07 22:14:37.689104 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Id: d32f58b7303541388483ca4b881a552e Jun 07 22:14:37.689104 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Name: tempest-AttachVolumeTestJSON-1459522994 Jun 07 22:14:37.689104 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Role: member,reader Jun 07 22:14:37.689104 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Roles: member,reader Jun 07 22:14:37.690812 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d32f58b7303541388483ca4b881a552e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_d32f58b7303541388483ca4b881a552e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d32f58b7303541388483ca4b881a552e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/d32f58b7303541388483ca4b881a552e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}] Jun 07 22:14:37.690812 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Tenant: tempest-AttachVolumeTestJSON-1459522994 Jun 07 22:14:37.690812 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Tenant-Id: d32f58b7303541388483ca4b881a552e Jun 07 22:14:37.690812 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1459522994 Jun 07 22:14:37.690812 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User: tempest-AttachVolumeTestJSON-1459522994-project Jun 07 22:14:37.690812 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Domain-Id: default Jun 07 22:14:37.690812 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Domain-Name: Default Jun 07 22:14:37.690812 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Id: 0e68eff6a08d4193b3167d47f4e1f97c Jun 07 22:14:37.690812 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Name: tempest-AttachVolumeTestJSON-1459522994-project Jun 07 22:14:37.690812 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: method: > Jun 07 22:14:37.690812 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: exception: Instance f29be694-507c-48eb-9fdd-d20bef8f6609 could not be found. Jun 07 22:14:37.690812 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: action_args: {'id': 'f29be694-507c-48eb-9fdd-d20bef8f6609'} Jun 07 22:14:37.691889 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 22:14:37.691889 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:14:37.691889 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 22:14:37.691889 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 22:14:37.691889 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 22:14:37.691889 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 22:14:37.691889 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 22:14:37.691889 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 22:14:37.691889 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 22:14:37.691889 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 22:14:37.691889 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f29be694-507c-48eb-9fdd-d20bef8f6609 could not be found. Jun 07 22:14:37.691889 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:14:37.691889 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:14:37.691889 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:14:37.691889 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:14:37.691889 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:14:37.691889 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:14:37.691889 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 22:14:37.691889 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 22:14:37.691889 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 22:14:37.693354 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 22:14:37.693354 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 22:14:37.693354 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 22:14:37.693354 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 22:14:37.693354 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 22:14:37.693354 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 22:14:37.693354 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 22:14:37.693354 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f29be694-507c-48eb-9fdd-d20bef8f6609 could not be found. Jun 07 22:14:37.693354 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:14:37.693354 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:14:37.693354 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:14:37.693354 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:14:37.693354 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:14:37.693354 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:14:37.693354 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 22:14:37.693354 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 22:14:37.693354 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f29be694-507c-48eb-9fdd-d20bef8f6609 could not be found. Jun 07 22:14:37.693354 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:14:37.694781 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-e7583048-a0cf-4ba5-8444-c1fa8baa0b32 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] Returning 404 to user: Instance f29be694-507c-48eb-9fdd-d20bef8f6609 could not be found. {{(pid=117970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 22:14:37.694781 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-e7583048-a0cf-4ba5-8444-c1fa8baa0b32 tempest-AttachVolumeTestJSON-1459522994 tempest-AttachVolumeTestJSON-1459522994-project] 10.222.0.13 "GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609" status: 404 len: 111 microversion: 2.1 time: 0.033067 Jun 07 22:14:37.694781 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 642/1305] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:14:37 2022] GET /compute/v2.1/servers/f29be694-507c-48eb-9fdd-d20bef8f6609 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 22:14:37.998769 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-d850bf23-ce16-4212-ba14-07b670f060ff tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:14:37.999262 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-d850bf23-ce16-4212-ba14-07b670f060ff tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 994885ff-724e-44e8-8c8f-1150c334e1fe] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:14:38.005832 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-d850bf23-ce16-4212-ba14-07b670f060ff tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:38.006282 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-d850bf23-ce16-4212-ba14-07b670f060ff tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:38.007040 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-d850bf23-ce16-4212-ba14-07b670f060ff tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:38.007516 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-d850bf23-ce16-4212-ba14-07b670f060ff tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:38.085404 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:14:38.089697 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.objects.instance [None req-d850bf23-ce16-4212-ba14-07b670f060ff tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lazy-loading 'services' on Instance uuid 994885ff-724e-44e8-8c8f-1150c334e1fe {{(pid=117971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 22:14:38.165677 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-d850bf23-ce16-4212-ba14-07b670f060ff tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "DELETE /compute/v2.1/servers/994885ff-724e-44e8-8c8f-1150c334e1fe/os-volume_attachments/045436f3-3573-40a7-955a-f97a7495ff4a" status: 202 len: 0 microversion: 2.1 time: 0.170630 Jun 07 22:14:38.166355 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 664/1306] 10.222.0.13 () {58 vars in 1415 bytes} [Tue Jun 7 22:14:37 2022] DELETE /compute/v2.1/servers/994885ff-724e-44e8-8c8f-1150c334e1fe/os-volume_attachments/045436f3-3573-40a7-955a-f97a7495ff4a => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 22:14:38.174905 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-1d39cfbf-d9a9-4e9b-a469-8d8964c81ee2 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:14:38.176057 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-1d39cfbf-d9a9-4e9b-a469-8d8964c81ee2 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 994885ff-724e-44e8-8c8f-1150c334e1fe] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:14:38.191623 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1d39cfbf-d9a9-4e9b-a469-8d8964c81ee2 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:38.192096 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1d39cfbf-d9a9-4e9b-a469-8d8964c81ee2 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:38.192847 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1d39cfbf-d9a9-4e9b-a469-8d8964c81ee2 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:38.193475 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1d39cfbf-d9a9-4e9b-a469-8d8964c81ee2 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:38.224951 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-1d39cfbf-d9a9-4e9b-a469-8d8964c81ee2 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/994885ff-724e-44e8-8c8f-1150c334e1fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054128 Jun 07 22:14:38.225528 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 643/1307] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jun 7 22:14:38 2022] GET /compute/v2.1/servers/994885ff-724e-44e8-8c8f-1150c334e1fe/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:14:39.238621 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-37eae078-3ea8-4fd9-a868-d9e7f40ac9a7 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:14:39.239749 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-37eae078-3ea8-4fd9-a868-d9e7f40ac9a7 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 994885ff-724e-44e8-8c8f-1150c334e1fe] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:14:39.246263 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-37eae078-3ea8-4fd9-a868-d9e7f40ac9a7 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:39.247692 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-37eae078-3ea8-4fd9-a868-d9e7f40ac9a7 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:39.248680 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-37eae078-3ea8-4fd9-a868-d9e7f40ac9a7 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:39.249360 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-37eae078-3ea8-4fd9-a868-d9e7f40ac9a7 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:39.280303 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-37eae078-3ea8-4fd9-a868-d9e7f40ac9a7 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/994885ff-724e-44e8-8c8f-1150c334e1fe/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046675 Jun 07 22:14:39.281203 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 665/1308] 10.222.0.13 () {58 vars in 1301 bytes} [Tue Jun 7 22:14:39 2022] GET /compute/v2.1/servers/994885ff-724e-44e8-8c8f-1150c334e1fe/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 07 22:14:39.341915 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-1bb8da51-e4e5-45b2-ba83-014aef0efd47 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:14:39.342447 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-1bb8da51-e4e5-45b2-ba83-014aef0efd47 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 994885ff-724e-44e8-8c8f-1150c334e1fe] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:14:39.349601 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1bb8da51-e4e5-45b2-ba83-014aef0efd47 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:39.350047 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1bb8da51-e4e5-45b2-ba83-014aef0efd47 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:39.350816 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1bb8da51-e4e5-45b2-ba83-014aef0efd47 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:39.351255 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1bb8da51-e4e5-45b2-ba83-014aef0efd47 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:39.376337 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-1bb8da51-e4e5-45b2-ba83-014aef0efd47 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 994885ff-724e-44e8-8c8f-1150c334e1fe] Going to try to terminate instance {{(pid=117970) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 22:14:39.471632 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-1bb8da51-e4e5-45b2-ba83-014aef0efd47 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "DELETE /compute/v2.1/servers/994885ff-724e-44e8-8c8f-1150c334e1fe" status: 204 len: 0 microversion: 2.1 time: 0.133317 Jun 07 22:14:39.476039 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 644/1309] 10.222.0.13 () {58 vars in 1238 bytes} [Tue Jun 7 22:14:39 2022] DELETE /compute/v2.1/servers/994885ff-724e-44e8-8c8f-1150c334e1fe => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 22:14:39.486135 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-913627c6-8c7c-4709-bd52-574ab5df714a tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:14:39.487195 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-913627c6-8c7c-4709-bd52-574ab5df714a tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 994885ff-724e-44e8-8c8f-1150c334e1fe] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:14:39.494829 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-913627c6-8c7c-4709-bd52-574ab5df714a tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:39.495217 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-913627c6-8c7c-4709-bd52-574ab5df714a tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:39.496151 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-913627c6-8c7c-4709-bd52-574ab5df714a tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:39.496596 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-913627c6-8c7c-4709-bd52-574ab5df714a tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:39.723098 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-913627c6-8c7c-4709-bd52-574ab5df714a tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:14:39.731132 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-913627c6-8c7c-4709-bd52-574ab5df714a tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/994885ff-724e-44e8-8c8f-1150c334e1fe" status: 200 len: 1682 microversion: 2.1 time: 0.249343 Jun 07 22:14:39.731728 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 666/1310] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:14:39 2022] GET /compute/v2.1/servers/994885ff-724e-44e8-8c8f-1150c334e1fe => generated 1682 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:14:40.749932 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-667a4036-c97a-4033-9492-8a589da093ed tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:14:40.750863 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-667a4036-c97a-4033-9492-8a589da093ed tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 994885ff-724e-44e8-8c8f-1150c334e1fe] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:14:40.758245 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-667a4036-c97a-4033-9492-8a589da093ed tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:40.758827 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-667a4036-c97a-4033-9492-8a589da093ed tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:40.759725 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-667a4036-c97a-4033-9492-8a589da093ed tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:40.760761 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-667a4036-c97a-4033-9492-8a589da093ed tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:40.915831 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-667a4036-c97a-4033-9492-8a589da093ed tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:14:40.929798 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-667a4036-c97a-4033-9492-8a589da093ed tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/994885ff-724e-44e8-8c8f-1150c334e1fe" status: 200 len: 1682 microversion: 2.1 time: 0.183973 Jun 07 22:14:40.941204 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 645/1311] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:14:40 2022] GET /compute/v2.1/servers/994885ff-724e-44e8-8c8f-1150c334e1fe => generated 1682 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:14:41.946930 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-e4019a94-9b47-46f4-a204-70897c19f6c5 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:14:41.948100 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-e4019a94-9b47-46f4-a204-70897c19f6c5 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 994885ff-724e-44e8-8c8f-1150c334e1fe] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:14:41.954858 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e4019a94-9b47-46f4-a204-70897c19f6c5 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:41.955822 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e4019a94-9b47-46f4-a204-70897c19f6c5 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:41.957044 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e4019a94-9b47-46f4-a204-70897c19f6c5 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:41.957717 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e4019a94-9b47-46f4-a204-70897c19f6c5 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:42.097275 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-e4019a94-9b47-46f4-a204-70897c19f6c5 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:14:42.105223 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-e4019a94-9b47-46f4-a204-70897c19f6c5 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/994885ff-724e-44e8-8c8f-1150c334e1fe" status: 200 len: 1682 microversion: 2.1 time: 0.162080 Jun 07 22:14:42.105956 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 667/1312] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:14:41 2022] GET /compute/v2.1/servers/994885ff-724e-44e8-8c8f-1150c334e1fe => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:14:42.608257 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [req-c017fe94-5457-4927-9a10-0934fb9f2b45 req-371c3f0a-c198-4eb1-8c68-df6fe52bf258 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "994885ff-724e-44e8-8c8f-1150c334e1fe", "name": "network-vif-deleted", "tag": "1b3e54fe-3bfd-42a2-a29d-62eb36391997"}]} {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:14:42.617825 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [req-c017fe94-5457-4927-9a10-0934fb9f2b45 req-371c3f0a-c198-4eb1-8c68-df6fe52bf258 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:42.618510 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [req-c017fe94-5457-4927-9a10-0934fb9f2b45 req-371c3f0a-c198-4eb1-8c68-df6fe52bf258 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:42.630794 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.compute.server_external_events [req-c017fe94-5457-4927-9a10-0934fb9f2b45 req-371c3f0a-c198-4eb1-8c68-df6fe52bf258 service nova] Creating event network-vif-deleted:1b3e54fe-3bfd-42a2-a29d-62eb36391997 for instance 994885ff-724e-44e8-8c8f-1150c334e1fe on hv-cinder-83552 Jun 07 22:14:42.635753 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [req-c017fe94-5457-4927-9a10-0934fb9f2b45 req-371c3f0a-c198-4eb1-8c68-df6fe52bf258 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031575 Jun 07 22:14:42.636344 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 646/1313] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:14:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:14:43.122115 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-e3f5ffba-5873-449c-a67a-befa6e0d9ec1 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:14:43.122607 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-e3f5ffba-5873-449c-a67a-befa6e0d9ec1 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 994885ff-724e-44e8-8c8f-1150c334e1fe] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:14:43.131230 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e3f5ffba-5873-449c-a67a-befa6e0d9ec1 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:43.131382 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e3f5ffba-5873-449c-a67a-befa6e0d9ec1 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:43.132121 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e3f5ffba-5873-449c-a67a-befa6e0d9ec1 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:43.132710 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e3f5ffba-5873-449c-a67a-befa6e0d9ec1 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:43.172747 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e3f5ffba-5873-449c-a67a-befa6e0d9ec1 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:43.173097 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e3f5ffba-5873-449c-a67a-befa6e0d9ec1 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:43.173548 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.objects.instance [None req-e3f5ffba-5873-449c-a67a-befa6e0d9ec1 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lazy-loading 'fault' on Instance uuid 994885ff-724e-44e8-8c8f-1150c334e1fe {{(pid=117971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 22:14:43.222140 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-e3f5ffba-5873-449c-a67a-befa6e0d9ec1 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607b70b4d6e14c95ae2880dd3577c8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d73c22e28a450a99d0952aa686dccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:14:43.231353 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-e3f5ffba-5873-449c-a67a-befa6e0d9ec1 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/994885ff-724e-44e8-8c8f-1150c334e1fe" status: 200 len: 1331 microversion: 2.1 time: 0.113137 Jun 07 22:14:43.241998 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 668/1314] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:14:43 2022] GET /compute/v2.1/servers/994885ff-724e-44e8-8c8f-1150c334e1fe => generated 1331 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:14:44.252777 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-6defef83-2eb5-4d0e-8451-a737fc69c187 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:14:44.254055 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-6defef83-2eb5-4d0e-8451-a737fc69c187 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 994885ff-724e-44e8-8c8f-1150c334e1fe] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:14:44.260321 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6defef83-2eb5-4d0e-8451-a737fc69c187 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:44.260766 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6defef83-2eb5-4d0e-8451-a737fc69c187 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:44.261550 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6defef83-2eb5-4d0e-8451-a737fc69c187 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:44.261984 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6defef83-2eb5-4d0e-8451-a737fc69c187 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:44.281328 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.wsgi [None req-6defef83-2eb5-4d0e-8451-a737fc69c187 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] HTTP exception thrown: Instance 994885ff-724e-44e8-8c8f-1150c334e1fe could not be found. Jun 07 22:14:44.282945 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-6defef83-2eb5-4d0e-8451-a737fc69c187 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Request method failure captured: Jun 07 22:14:44.282945 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: request: GET /compute/v2.1/servers/994885ff-724e-44e8-8c8f-1150c334e1fe HTTP/1.1 Jun 07 22:14:44.282945 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Accept: application/json Jun 07 22:14:44.282945 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Accept-Encoding: identity Jun 07 22:14:44.282945 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Connection: close Jun 07 22:14:44.282945 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Content-Length: 0 Jun 07 22:14:44.282945 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Content-Type: application/json Jun 07 22:14:44.282945 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Host: 10.222.0.13 Jun 07 22:14:44.282945 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Openstack-System-Scope: None Jun 07 22:14:44.282945 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: User-Agent: python-urllib3/1.26.9 Jun 07 22:14:44.282945 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Auth-Token: gAAAAABin8srQLbStzUvCeAnRNadMyGlcKFPPrFg9QuKcDpjIyywTcK8viTuRoYw24qPuVh7wMg6UWBPhX8hggkc6BZRBiLlvXhF5-X03MFchuLsFFC__9JBLL5O-wkDCN77ZFc33WSFPA37h4CwlIMlU5FumSkwBM-s6ELIPTrdhu_0TKT1s2Y Jun 07 22:14:44.282945 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Domain-Id: None Jun 07 22:14:44.282945 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Domain-Name: None Jun 07 22:14:44.282945 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Identity-Status: Confirmed Jun 07 22:14:44.282945 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Is-Admin-Project: True Jun 07 22:14:44.282945 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Domain-Id: default Jun 07 22:14:44.282945 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Domain-Name: Default Jun 07 22:14:44.282945 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Id: 49d73c22e28a450a99d0952aa686dccf Jun 07 22:14:44.282945 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Name: tempest-AttachVolumeNegativeTest-1740363357 Jun 07 22:14:44.282945 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Role: member,reader Jun 07 22:14:44.282945 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Roles: member,reader Jun 07 22:14:44.284650 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/49d73c22e28a450a99d0952aa686dccf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_49d73c22e28a450a99d0952aa686dccf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/49d73c22e28a450a99d0952aa686dccf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/49d73c22e28a450a99d0952aa686dccf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}] Jun 07 22:14:44.284650 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Tenant: tempest-AttachVolumeNegativeTest-1740363357 Jun 07 22:14:44.284650 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Tenant-Id: 49d73c22e28a450a99d0952aa686dccf Jun 07 22:14:44.284650 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1740363357 Jun 07 22:14:44.284650 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User: tempest-AttachVolumeNegativeTest-1740363357-project Jun 07 22:14:44.284650 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Domain-Id: default Jun 07 22:14:44.284650 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Domain-Name: Default Jun 07 22:14:44.284650 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Id: 607b70b4d6e14c95ae2880dd3577c8ae Jun 07 22:14:44.284650 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Name: tempest-AttachVolumeNegativeTest-1740363357-project Jun 07 22:14:44.284650 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: method: > Jun 07 22:14:44.284650 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: exception: Instance 994885ff-724e-44e8-8c8f-1150c334e1fe could not be found. Jun 07 22:14:44.284650 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: action_args: {'id': '994885ff-724e-44e8-8c8f-1150c334e1fe'} Jun 07 22:14:44.285617 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 22:14:44.285617 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:14:44.285617 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 22:14:44.285617 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 22:14:44.285617 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 22:14:44.285617 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 22:14:44.285617 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 22:14:44.285617 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 22:14:44.285617 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 22:14:44.285617 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 22:14:44.285617 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 994885ff-724e-44e8-8c8f-1150c334e1fe could not be found. Jun 07 22:14:44.285617 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:14:44.285617 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:14:44.285617 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:14:44.285617 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:14:44.285617 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:14:44.285617 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:14:44.285617 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 22:14:44.285617 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 22:14:44.285617 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 22:14:44.287152 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 22:14:44.287152 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 22:14:44.287152 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 22:14:44.287152 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 22:14:44.287152 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 22:14:44.287152 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 22:14:44.287152 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 22:14:44.287152 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 994885ff-724e-44e8-8c8f-1150c334e1fe could not be found. Jun 07 22:14:44.287152 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:14:44.287152 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:14:44.287152 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:14:44.287152 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:14:44.287152 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:14:44.287152 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:14:44.287152 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 22:14:44.287152 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 22:14:44.287152 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 994885ff-724e-44e8-8c8f-1150c334e1fe could not be found. Jun 07 22:14:44.287152 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:14:44.288502 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-6defef83-2eb5-4d0e-8451-a737fc69c187 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Returning 404 to user: Instance 994885ff-724e-44e8-8c8f-1150c334e1fe could not be found. {{(pid=117970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 22:14:44.288502 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-6defef83-2eb5-4d0e-8451-a737fc69c187 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/994885ff-724e-44e8-8c8f-1150c334e1fe" status: 404 len: 111 microversion: 2.1 time: 0.038796 Jun 07 22:14:44.288502 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 647/1315] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:14:44 2022] GET /compute/v2.1/servers/994885ff-724e-44e8-8c8f-1150c334e1fe => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 22:14:44.293910 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-a0d301a2-7784-46ca-8aa8-6458122ff665 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '.version_select at 0x7f92f1fad160>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:14:44.311755 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-a0d301a2-7784-46ca-8aa8-6458122ff665 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-516587500" status: 202 len: 0 microversion: 2.1 time: 0.021765 Jun 07 22:14:44.312316 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 669/1316] 10.222.0.13 () {58 vars in 1217 bytes} [Tue Jun 7 22:14:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-516587500 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 22:14:46.072976 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-b18a00e5-975e-425e-a075-030137092ec3 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:14:46.073463 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-b18a00e5-975e-425e-a075-030137092ec3 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 994885ff-724e-44e8-8c8f-1150c334e1fe] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:14:46.079916 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-b18a00e5-975e-425e-a075-030137092ec3 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:46.091538 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-b18a00e5-975e-425e-a075-030137092ec3 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:46.091538 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-b18a00e5-975e-425e-a075-030137092ec3 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:46.091538 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-b18a00e5-975e-425e-a075-030137092ec3 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:46.105039 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.wsgi [None req-b18a00e5-975e-425e-a075-030137092ec3 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] HTTP exception thrown: Instance 994885ff-724e-44e8-8c8f-1150c334e1fe could not be found. Jun 07 22:14:46.106583 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-b18a00e5-975e-425e-a075-030137092ec3 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Request method failure captured: Jun 07 22:14:46.106583 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: request: DELETE /compute/v2.1/servers/994885ff-724e-44e8-8c8f-1150c334e1fe HTTP/1.1 Jun 07 22:14:46.106583 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Accept: application/json Jun 07 22:14:46.106583 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Accept-Encoding: identity Jun 07 22:14:46.106583 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Connection: close Jun 07 22:14:46.106583 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Content-Length: 0 Jun 07 22:14:46.106583 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Content-Type: application/json Jun 07 22:14:46.106583 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Host: 10.222.0.13 Jun 07 22:14:46.106583 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Openstack-System-Scope: None Jun 07 22:14:46.106583 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: User-Agent: python-urllib3/1.26.9 Jun 07 22:14:46.106583 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Auth-Token: gAAAAABin8srQLbStzUvCeAnRNadMyGlcKFPPrFg9QuKcDpjIyywTcK8viTuRoYw24qPuVh7wMg6UWBPhX8hggkc6BZRBiLlvXhF5-X03MFchuLsFFC__9JBLL5O-wkDCN77ZFc33WSFPA37h4CwlIMlU5FumSkwBM-s6ELIPTrdhu_0TKT1s2Y Jun 07 22:14:46.106583 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Domain-Id: None Jun 07 22:14:46.106583 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Domain-Name: None Jun 07 22:14:46.106583 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Identity-Status: Confirmed Jun 07 22:14:46.106583 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Is-Admin-Project: True Jun 07 22:14:46.106583 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Domain-Id: default Jun 07 22:14:46.106583 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Domain-Name: Default Jun 07 22:14:46.106583 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Id: 49d73c22e28a450a99d0952aa686dccf Jun 07 22:14:46.106583 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Name: tempest-AttachVolumeNegativeTest-1740363357 Jun 07 22:14:46.106583 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Role: member,reader Jun 07 22:14:46.106583 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Roles: member,reader Jun 07 22:14:46.108283 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/49d73c22e28a450a99d0952aa686dccf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_49d73c22e28a450a99d0952aa686dccf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/49d73c22e28a450a99d0952aa686dccf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/49d73c22e28a450a99d0952aa686dccf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}] Jun 07 22:14:46.108283 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Tenant: tempest-AttachVolumeNegativeTest-1740363357 Jun 07 22:14:46.108283 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Tenant-Id: 49d73c22e28a450a99d0952aa686dccf Jun 07 22:14:46.108283 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1740363357 Jun 07 22:14:46.108283 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User: tempest-AttachVolumeNegativeTest-1740363357-project Jun 07 22:14:46.108283 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Domain-Id: default Jun 07 22:14:46.108283 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Domain-Name: Default Jun 07 22:14:46.108283 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Id: 607b70b4d6e14c95ae2880dd3577c8ae Jun 07 22:14:46.108283 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Name: tempest-AttachVolumeNegativeTest-1740363357-project Jun 07 22:14:46.108283 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: method: > Jun 07 22:14:46.108283 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: exception: Instance 994885ff-724e-44e8-8c8f-1150c334e1fe could not be found. Jun 07 22:14:46.108283 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: action_args: {'id': '994885ff-724e-44e8-8c8f-1150c334e1fe'} Jun 07 22:14:46.109275 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 22:14:46.109275 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:14:46.109275 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 22:14:46.109275 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 22:14:46.109275 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 22:14:46.109275 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 22:14:46.109275 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 22:14:46.109275 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 22:14:46.109275 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 22:14:46.109275 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 22:14:46.109275 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 994885ff-724e-44e8-8c8f-1150c334e1fe could not be found. Jun 07 22:14:46.109275 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:14:46.109275 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:14:46.109275 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:14:46.109275 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:14:46.109275 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:14:46.109275 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:14:46.109275 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 22:14:46.109275 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 22:14:46.109275 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 22:14:46.110990 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 22:14:46.110990 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 22:14:46.110990 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 22:14:46.110990 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 22:14:46.110990 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 22:14:46.110990 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 22:14:46.110990 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 22:14:46.110990 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 22:14:46.110990 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 22:14:46.110990 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 994885ff-724e-44e8-8c8f-1150c334e1fe could not be found. Jun 07 22:14:46.110990 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:14:46.110990 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:14:46.110990 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:14:46.110990 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:14:46.110990 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:14:46.110990 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:14:46.110990 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 22:14:46.110990 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 22:14:46.110990 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 994885ff-724e-44e8-8c8f-1150c334e1fe could not be found. Jun 07 22:14:46.110990 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:14:46.113986 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-b18a00e5-975e-425e-a075-030137092ec3 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Returning 404 to user: Instance 994885ff-724e-44e8-8c8f-1150c334e1fe could not be found. {{(pid=117970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 22:14:46.113986 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-b18a00e5-975e-425e-a075-030137092ec3 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "DELETE /compute/v2.1/servers/994885ff-724e-44e8-8c8f-1150c334e1fe" status: 404 len: 111 microversion: 2.1 time: 0.038925 Jun 07 22:14:46.113986 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 648/1317] 10.222.0.13 () {58 vars in 1238 bytes} [Tue Jun 7 22:14:46 2022] DELETE /compute/v2.1/servers/994885ff-724e-44e8-8c8f-1150c334e1fe => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 22:14:46.118193 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-b7c2c8c6-aa2e-4240-8f71-561885aef8e6 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:14:46.118801 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-b7c2c8c6-aa2e-4240-8f71-561885aef8e6 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 994885ff-724e-44e8-8c8f-1150c334e1fe] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:14:46.125404 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b7c2c8c6-aa2e-4240-8f71-561885aef8e6 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:46.125845 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b7c2c8c6-aa2e-4240-8f71-561885aef8e6 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:46.126596 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b7c2c8c6-aa2e-4240-8f71-561885aef8e6 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:46.127096 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b7c2c8c6-aa2e-4240-8f71-561885aef8e6 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:46.140239 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.wsgi [None req-b7c2c8c6-aa2e-4240-8f71-561885aef8e6 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] HTTP exception thrown: Instance 994885ff-724e-44e8-8c8f-1150c334e1fe could not be found. Jun 07 22:14:46.141896 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-b7c2c8c6-aa2e-4240-8f71-561885aef8e6 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Request method failure captured: Jun 07 22:14:46.141896 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: request: GET /compute/v2.1/servers/994885ff-724e-44e8-8c8f-1150c334e1fe HTTP/1.1 Jun 07 22:14:46.141896 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Accept: application/json Jun 07 22:14:46.141896 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Accept-Encoding: identity Jun 07 22:14:46.141896 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Connection: close Jun 07 22:14:46.141896 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Content-Length: 0 Jun 07 22:14:46.141896 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Content-Type: application/json Jun 07 22:14:46.141896 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Host: 10.222.0.13 Jun 07 22:14:46.141896 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Openstack-System-Scope: None Jun 07 22:14:46.141896 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: User-Agent: python-urllib3/1.26.9 Jun 07 22:14:46.141896 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Auth-Token: gAAAAABin8srQLbStzUvCeAnRNadMyGlcKFPPrFg9QuKcDpjIyywTcK8viTuRoYw24qPuVh7wMg6UWBPhX8hggkc6BZRBiLlvXhF5-X03MFchuLsFFC__9JBLL5O-wkDCN77ZFc33WSFPA37h4CwlIMlU5FumSkwBM-s6ELIPTrdhu_0TKT1s2Y Jun 07 22:14:46.141896 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Domain-Id: None Jun 07 22:14:46.141896 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Domain-Name: None Jun 07 22:14:46.141896 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Identity-Status: Confirmed Jun 07 22:14:46.141896 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Is-Admin-Project: True Jun 07 22:14:46.141896 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Domain-Id: default Jun 07 22:14:46.141896 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Domain-Name: Default Jun 07 22:14:46.141896 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Id: 49d73c22e28a450a99d0952aa686dccf Jun 07 22:14:46.141896 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Name: tempest-AttachVolumeNegativeTest-1740363357 Jun 07 22:14:46.141896 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Role: member,reader Jun 07 22:14:46.141896 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Roles: member,reader Jun 07 22:14:46.144365 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/49d73c22e28a450a99d0952aa686dccf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_49d73c22e28a450a99d0952aa686dccf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/49d73c22e28a450a99d0952aa686dccf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/49d73c22e28a450a99d0952aa686dccf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}] Jun 07 22:14:46.144365 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant: tempest-AttachVolumeNegativeTest-1740363357 Jun 07 22:14:46.144365 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant-Id: 49d73c22e28a450a99d0952aa686dccf Jun 07 22:14:46.144365 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1740363357 Jun 07 22:14:46.144365 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User: tempest-AttachVolumeNegativeTest-1740363357-project Jun 07 22:14:46.144365 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Domain-Id: default Jun 07 22:14:46.144365 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Domain-Name: Default Jun 07 22:14:46.144365 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Id: 607b70b4d6e14c95ae2880dd3577c8ae Jun 07 22:14:46.144365 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Name: tempest-AttachVolumeNegativeTest-1740363357-project Jun 07 22:14:46.144365 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: method: > Jun 07 22:14:46.144365 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: exception: Instance 994885ff-724e-44e8-8c8f-1150c334e1fe could not be found. Jun 07 22:14:46.144365 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: action_args: {'id': '994885ff-724e-44e8-8c8f-1150c334e1fe'} Jun 07 22:14:46.145313 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 22:14:46.145313 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:14:46.145313 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 22:14:46.145313 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 22:14:46.145313 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 22:14:46.145313 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 22:14:46.145313 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 22:14:46.145313 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 22:14:46.145313 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 22:14:46.145313 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 22:14:46.145313 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 994885ff-724e-44e8-8c8f-1150c334e1fe could not be found. Jun 07 22:14:46.145313 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:14:46.145313 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:14:46.145313 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:14:46.145313 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:14:46.145313 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:14:46.145313 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:14:46.145313 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 22:14:46.145313 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 22:14:46.145313 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 22:14:46.146832 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 22:14:46.146832 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 22:14:46.146832 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 22:14:46.146832 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 22:14:46.146832 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 22:14:46.146832 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 22:14:46.146832 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 22:14:46.146832 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 994885ff-724e-44e8-8c8f-1150c334e1fe could not be found. Jun 07 22:14:46.146832 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:14:46.146832 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:14:46.146832 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:14:46.146832 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:14:46.146832 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:14:46.146832 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:14:46.146832 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 22:14:46.146832 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 22:14:46.146832 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 994885ff-724e-44e8-8c8f-1150c334e1fe could not be found. Jun 07 22:14:46.146832 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:14:46.148322 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-b7c2c8c6-aa2e-4240-8f71-561885aef8e6 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Returning 404 to user: Instance 994885ff-724e-44e8-8c8f-1150c334e1fe could not be found. {{(pid=117971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 22:14:46.148322 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-b7c2c8c6-aa2e-4240-8f71-561885aef8e6 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/994885ff-724e-44e8-8c8f-1150c334e1fe" status: 404 len: 111 microversion: 2.1 time: 0.029601 Jun 07 22:14:46.148322 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 670/1318] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:14:46 2022] GET /compute/v2.1/servers/994885ff-724e-44e8-8c8f-1150c334e1fe => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 22:14:47.278238 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-47fe6fb3-3845-48a9-af19-1f2f5fb49c8c tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:14:47.278745 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-47fe6fb3-3845-48a9-af19-1f2f5fb49c8c tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: b8a810a4-60df-4062-baae-8f11e0615a49] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:14:47.286611 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-47fe6fb3-3845-48a9-af19-1f2f5fb49c8c tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:47.287056 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-47fe6fb3-3845-48a9-af19-1f2f5fb49c8c tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:47.287855 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-47fe6fb3-3845-48a9-af19-1f2f5fb49c8c tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:47.288288 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-47fe6fb3-3845-48a9-af19-1f2f5fb49c8c tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:47.301571 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.wsgi [None req-47fe6fb3-3845-48a9-af19-1f2f5fb49c8c tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] HTTP exception thrown: Instance b8a810a4-60df-4062-baae-8f11e0615a49 could not be found. Jun 07 22:14:47.303099 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-47fe6fb3-3845-48a9-af19-1f2f5fb49c8c tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Request method failure captured: Jun 07 22:14:47.303099 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: request: DELETE /compute/v2.1/servers/b8a810a4-60df-4062-baae-8f11e0615a49 HTTP/1.1 Jun 07 22:14:47.303099 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Accept: application/json Jun 07 22:14:47.303099 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Accept-Encoding: identity Jun 07 22:14:47.303099 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Connection: close Jun 07 22:14:47.303099 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Content-Length: 0 Jun 07 22:14:47.303099 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Content-Type: application/json Jun 07 22:14:47.303099 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Host: 10.222.0.13 Jun 07 22:14:47.303099 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Openstack-System-Scope: None Jun 07 22:14:47.303099 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: User-Agent: python-urllib3/1.26.9 Jun 07 22:14:47.303099 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Auth-Token: gAAAAABin8srQLbStzUvCeAnRNadMyGlcKFPPrFg9QuKcDpjIyywTcK8viTuRoYw24qPuVh7wMg6UWBPhX8hggkc6BZRBiLlvXhF5-X03MFchuLsFFC__9JBLL5O-wkDCN77ZFc33WSFPA37h4CwlIMlU5FumSkwBM-s6ELIPTrdhu_0TKT1s2Y Jun 07 22:14:47.303099 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Domain-Id: None Jun 07 22:14:47.303099 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Domain-Name: None Jun 07 22:14:47.303099 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Identity-Status: Confirmed Jun 07 22:14:47.303099 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Is-Admin-Project: True Jun 07 22:14:47.303099 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Domain-Id: default Jun 07 22:14:47.303099 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Domain-Name: Default Jun 07 22:14:47.303099 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Id: 49d73c22e28a450a99d0952aa686dccf Jun 07 22:14:47.303099 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Name: tempest-AttachVolumeNegativeTest-1740363357 Jun 07 22:14:47.303099 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Role: member,reader Jun 07 22:14:47.303099 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Roles: member,reader Jun 07 22:14:47.304694 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/49d73c22e28a450a99d0952aa686dccf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_49d73c22e28a450a99d0952aa686dccf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/49d73c22e28a450a99d0952aa686dccf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/49d73c22e28a450a99d0952aa686dccf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}] Jun 07 22:14:47.304694 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Tenant: tempest-AttachVolumeNegativeTest-1740363357 Jun 07 22:14:47.304694 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Tenant-Id: 49d73c22e28a450a99d0952aa686dccf Jun 07 22:14:47.304694 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1740363357 Jun 07 22:14:47.304694 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User: tempest-AttachVolumeNegativeTest-1740363357-project Jun 07 22:14:47.304694 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Domain-Id: default Jun 07 22:14:47.304694 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Domain-Name: Default Jun 07 22:14:47.304694 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Id: 607b70b4d6e14c95ae2880dd3577c8ae Jun 07 22:14:47.304694 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Name: tempest-AttachVolumeNegativeTest-1740363357-project Jun 07 22:14:47.304694 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: method: > Jun 07 22:14:47.304694 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: exception: Instance b8a810a4-60df-4062-baae-8f11e0615a49 could not be found. Jun 07 22:14:47.304694 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: action_args: {'id': 'b8a810a4-60df-4062-baae-8f11e0615a49'} Jun 07 22:14:47.305605 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 22:14:47.305605 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:14:47.305605 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 22:14:47.305605 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 22:14:47.305605 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 22:14:47.305605 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 22:14:47.305605 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 22:14:47.305605 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 22:14:47.305605 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 22:14:47.305605 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 22:14:47.305605 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8a810a4-60df-4062-baae-8f11e0615a49 could not be found. Jun 07 22:14:47.305605 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:14:47.305605 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:14:47.305605 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:14:47.305605 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:14:47.305605 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:14:47.305605 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:14:47.305605 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 22:14:47.305605 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 22:14:47.305605 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 22:14:47.307096 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 22:14:47.307096 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 22:14:47.307096 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 22:14:47.307096 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 22:14:47.307096 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 22:14:47.307096 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 22:14:47.307096 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 22:14:47.307096 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 22:14:47.307096 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 22:14:47.307096 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8a810a4-60df-4062-baae-8f11e0615a49 could not be found. Jun 07 22:14:47.307096 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:14:47.307096 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:14:47.307096 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:14:47.307096 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:14:47.307096 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:14:47.307096 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:14:47.307096 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 22:14:47.307096 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 22:14:47.307096 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8a810a4-60df-4062-baae-8f11e0615a49 could not be found. Jun 07 22:14:47.307096 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:14:47.308616 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-47fe6fb3-3845-48a9-af19-1f2f5fb49c8c tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Returning 404 to user: Instance b8a810a4-60df-4062-baae-8f11e0615a49 could not be found. {{(pid=117970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 22:14:47.308616 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-47fe6fb3-3845-48a9-af19-1f2f5fb49c8c tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "DELETE /compute/v2.1/servers/b8a810a4-60df-4062-baae-8f11e0615a49" status: 404 len: 111 microversion: 2.1 time: 0.030141 Jun 07 22:14:47.308616 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 649/1319] 10.222.0.13 () {58 vars in 1238 bytes} [Tue Jun 7 22:14:47 2022] DELETE /compute/v2.1/servers/b8a810a4-60df-4062-baae-8f11e0615a49 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 22:14:47.312867 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-462b8f15-772f-49ec-badb-9d076227ffd2 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:14:47.313480 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-462b8f15-772f-49ec-badb-9d076227ffd2 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: b8a810a4-60df-4062-baae-8f11e0615a49] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:14:47.320105 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-462b8f15-772f-49ec-badb-9d076227ffd2 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:47.320554 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-462b8f15-772f-49ec-badb-9d076227ffd2 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:47.321316 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-462b8f15-772f-49ec-badb-9d076227ffd2 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:47.321748 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-462b8f15-772f-49ec-badb-9d076227ffd2 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:47.335609 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.wsgi [None req-462b8f15-772f-49ec-badb-9d076227ffd2 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] HTTP exception thrown: Instance b8a810a4-60df-4062-baae-8f11e0615a49 could not be found. Jun 07 22:14:47.337139 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-462b8f15-772f-49ec-badb-9d076227ffd2 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Request method failure captured: Jun 07 22:14:47.337139 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: request: GET /compute/v2.1/servers/b8a810a4-60df-4062-baae-8f11e0615a49 HTTP/1.1 Jun 07 22:14:47.337139 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Accept: application/json Jun 07 22:14:47.337139 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Accept-Encoding: identity Jun 07 22:14:47.337139 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Connection: close Jun 07 22:14:47.337139 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Content-Length: 0 Jun 07 22:14:47.337139 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Content-Type: application/json Jun 07 22:14:47.337139 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Host: 10.222.0.13 Jun 07 22:14:47.337139 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Openstack-System-Scope: None Jun 07 22:14:47.337139 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: User-Agent: python-urllib3/1.26.9 Jun 07 22:14:47.337139 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Auth-Token: gAAAAABin8srQLbStzUvCeAnRNadMyGlcKFPPrFg9QuKcDpjIyywTcK8viTuRoYw24qPuVh7wMg6UWBPhX8hggkc6BZRBiLlvXhF5-X03MFchuLsFFC__9JBLL5O-wkDCN77ZFc33WSFPA37h4CwlIMlU5FumSkwBM-s6ELIPTrdhu_0TKT1s2Y Jun 07 22:14:47.337139 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Domain-Id: None Jun 07 22:14:47.337139 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Domain-Name: None Jun 07 22:14:47.337139 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Identity-Status: Confirmed Jun 07 22:14:47.337139 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Is-Admin-Project: True Jun 07 22:14:47.337139 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Domain-Id: default Jun 07 22:14:47.337139 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Domain-Name: Default Jun 07 22:14:47.337139 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Id: 49d73c22e28a450a99d0952aa686dccf Jun 07 22:14:47.337139 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Name: tempest-AttachVolumeNegativeTest-1740363357 Jun 07 22:14:47.337139 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Role: member,reader Jun 07 22:14:47.337139 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Roles: member,reader Jun 07 22:14:47.338727 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/49d73c22e28a450a99d0952aa686dccf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_49d73c22e28a450a99d0952aa686dccf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/49d73c22e28a450a99d0952aa686dccf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/49d73c22e28a450a99d0952aa686dccf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}] Jun 07 22:14:47.338727 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant: tempest-AttachVolumeNegativeTest-1740363357 Jun 07 22:14:47.338727 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant-Id: 49d73c22e28a450a99d0952aa686dccf Jun 07 22:14:47.338727 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1740363357 Jun 07 22:14:47.338727 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User: tempest-AttachVolumeNegativeTest-1740363357-project Jun 07 22:14:47.338727 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Domain-Id: default Jun 07 22:14:47.338727 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Domain-Name: Default Jun 07 22:14:47.338727 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Id: 607b70b4d6e14c95ae2880dd3577c8ae Jun 07 22:14:47.338727 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Name: tempest-AttachVolumeNegativeTest-1740363357-project Jun 07 22:14:47.338727 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: method: > Jun 07 22:14:47.338727 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: exception: Instance b8a810a4-60df-4062-baae-8f11e0615a49 could not be found. Jun 07 22:14:47.338727 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: action_args: {'id': 'b8a810a4-60df-4062-baae-8f11e0615a49'} Jun 07 22:14:47.339828 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 22:14:47.339828 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:14:47.339828 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 22:14:47.339828 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 22:14:47.339828 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 22:14:47.339828 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 22:14:47.339828 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 22:14:47.339828 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 22:14:47.339828 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 22:14:47.339828 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 22:14:47.339828 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8a810a4-60df-4062-baae-8f11e0615a49 could not be found. Jun 07 22:14:47.339828 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:14:47.339828 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:14:47.339828 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:14:47.339828 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:14:47.339828 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:14:47.339828 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:14:47.339828 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 22:14:47.339828 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 22:14:47.339828 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 22:14:47.341353 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 22:14:47.341353 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 22:14:47.341353 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 22:14:47.341353 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 22:14:47.341353 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 22:14:47.341353 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 22:14:47.341353 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 22:14:47.341353 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8a810a4-60df-4062-baae-8f11e0615a49 could not be found. Jun 07 22:14:47.341353 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:14:47.341353 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:14:47.341353 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:14:47.341353 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:14:47.341353 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:14:47.341353 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:14:47.341353 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 22:14:47.341353 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 22:14:47.341353 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8a810a4-60df-4062-baae-8f11e0615a49 could not be found. Jun 07 22:14:47.341353 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:14:47.342767 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-462b8f15-772f-49ec-badb-9d076227ffd2 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Returning 404 to user: Instance b8a810a4-60df-4062-baae-8f11e0615a49 could not be found. {{(pid=117971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 22:14:47.342767 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-462b8f15-772f-49ec-badb-9d076227ffd2 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/b8a810a4-60df-4062-baae-8f11e0615a49" status: 404 len: 111 microversion: 2.1 time: 0.029425 Jun 07 22:14:47.342767 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 671/1320] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:14:47 2022] GET /compute/v2.1/servers/b8a810a4-60df-4062-baae-8f11e0615a49 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 22:14:47.347624 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-376579d2-51f8-4659-93fd-d55cb736f824 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:14:47.348119 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-376579d2-51f8-4659-93fd-d55cb736f824 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 53059fb5-bea1-4713-94dd-fb6cd8841fe9] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:14:47.354374 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-376579d2-51f8-4659-93fd-d55cb736f824 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:47.354824 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-376579d2-51f8-4659-93fd-d55cb736f824 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:47.355601 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-376579d2-51f8-4659-93fd-d55cb736f824 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:47.356036 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-376579d2-51f8-4659-93fd-d55cb736f824 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:47.369026 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.wsgi [None req-376579d2-51f8-4659-93fd-d55cb736f824 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] HTTP exception thrown: Instance 53059fb5-bea1-4713-94dd-fb6cd8841fe9 could not be found. Jun 07 22:14:47.370533 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-376579d2-51f8-4659-93fd-d55cb736f824 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Request method failure captured: Jun 07 22:14:47.370533 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: request: DELETE /compute/v2.1/servers/53059fb5-bea1-4713-94dd-fb6cd8841fe9 HTTP/1.1 Jun 07 22:14:47.370533 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Accept: application/json Jun 07 22:14:47.370533 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Accept-Encoding: identity Jun 07 22:14:47.370533 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Connection: close Jun 07 22:14:47.370533 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Content-Length: 0 Jun 07 22:14:47.370533 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Content-Type: application/json Jun 07 22:14:47.370533 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Host: 10.222.0.13 Jun 07 22:14:47.370533 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Openstack-System-Scope: None Jun 07 22:14:47.370533 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: User-Agent: python-urllib3/1.26.9 Jun 07 22:14:47.370533 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Auth-Token: gAAAAABin8srQLbStzUvCeAnRNadMyGlcKFPPrFg9QuKcDpjIyywTcK8viTuRoYw24qPuVh7wMg6UWBPhX8hggkc6BZRBiLlvXhF5-X03MFchuLsFFC__9JBLL5O-wkDCN77ZFc33WSFPA37h4CwlIMlU5FumSkwBM-s6ELIPTrdhu_0TKT1s2Y Jun 07 22:14:47.370533 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Domain-Id: None Jun 07 22:14:47.370533 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Domain-Name: None Jun 07 22:14:47.370533 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Identity-Status: Confirmed Jun 07 22:14:47.370533 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Is-Admin-Project: True Jun 07 22:14:47.370533 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Domain-Id: default Jun 07 22:14:47.370533 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Domain-Name: Default Jun 07 22:14:47.370533 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Id: 49d73c22e28a450a99d0952aa686dccf Jun 07 22:14:47.370533 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Name: tempest-AttachVolumeNegativeTest-1740363357 Jun 07 22:14:47.370533 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Role: member,reader Jun 07 22:14:47.370533 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Roles: member,reader Jun 07 22:14:47.372212 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/49d73c22e28a450a99d0952aa686dccf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_49d73c22e28a450a99d0952aa686dccf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/49d73c22e28a450a99d0952aa686dccf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/49d73c22e28a450a99d0952aa686dccf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}] Jun 07 22:14:47.372212 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Tenant: tempest-AttachVolumeNegativeTest-1740363357 Jun 07 22:14:47.372212 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Tenant-Id: 49d73c22e28a450a99d0952aa686dccf Jun 07 22:14:47.372212 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1740363357 Jun 07 22:14:47.372212 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User: tempest-AttachVolumeNegativeTest-1740363357-project Jun 07 22:14:47.372212 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Domain-Id: default Jun 07 22:14:47.372212 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Domain-Name: Default Jun 07 22:14:47.372212 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Id: 607b70b4d6e14c95ae2880dd3577c8ae Jun 07 22:14:47.372212 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Name: tempest-AttachVolumeNegativeTest-1740363357-project Jun 07 22:14:47.372212 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: method: > Jun 07 22:14:47.372212 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: exception: Instance 53059fb5-bea1-4713-94dd-fb6cd8841fe9 could not be found. Jun 07 22:14:47.372212 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: action_args: {'id': '53059fb5-bea1-4713-94dd-fb6cd8841fe9'} Jun 07 22:14:47.373129 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 22:14:47.373129 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:14:47.373129 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 22:14:47.373129 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 22:14:47.373129 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 22:14:47.373129 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 22:14:47.373129 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 22:14:47.373129 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 22:14:47.373129 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 22:14:47.373129 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 22:14:47.373129 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53059fb5-bea1-4713-94dd-fb6cd8841fe9 could not be found. Jun 07 22:14:47.373129 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:14:47.373129 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:14:47.373129 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:14:47.373129 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:14:47.373129 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:14:47.373129 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:14:47.373129 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 22:14:47.373129 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 22:14:47.373129 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 22:14:47.374729 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 22:14:47.374729 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 22:14:47.374729 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 22:14:47.374729 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 22:14:47.374729 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 22:14:47.374729 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 22:14:47.374729 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 22:14:47.374729 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 22:14:47.374729 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 22:14:47.374729 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53059fb5-bea1-4713-94dd-fb6cd8841fe9 could not be found. Jun 07 22:14:47.374729 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:14:47.374729 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:14:47.374729 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:14:47.374729 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:14:47.374729 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:14:47.374729 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:14:47.374729 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 22:14:47.374729 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 22:14:47.374729 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53059fb5-bea1-4713-94dd-fb6cd8841fe9 could not be found. Jun 07 22:14:47.374729 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:14:47.376367 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-376579d2-51f8-4659-93fd-d55cb736f824 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Returning 404 to user: Instance 53059fb5-bea1-4713-94dd-fb6cd8841fe9 could not be found. {{(pid=117970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 22:14:47.376367 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-376579d2-51f8-4659-93fd-d55cb736f824 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "DELETE /compute/v2.1/servers/53059fb5-bea1-4713-94dd-fb6cd8841fe9" status: 404 len: 111 microversion: 2.1 time: 0.028917 Jun 07 22:14:47.376367 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 650/1321] 10.222.0.13 () {58 vars in 1238 bytes} [Tue Jun 7 22:14:47 2022] DELETE /compute/v2.1/servers/53059fb5-bea1-4713-94dd-fb6cd8841fe9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 07 22:14:47.380092 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-7f427da5-f77a-436d-ab3c-f720d2c170d7 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:14:47.380700 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-7f427da5-f77a-436d-ab3c-f720d2c170d7 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 53059fb5-bea1-4713-94dd-fb6cd8841fe9] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:14:47.386577 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-7f427da5-f77a-436d-ab3c-f720d2c170d7 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:47.387028 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-7f427da5-f77a-436d-ab3c-f720d2c170d7 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:47.387823 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-7f427da5-f77a-436d-ab3c-f720d2c170d7 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:47.388257 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-7f427da5-f77a-436d-ab3c-f720d2c170d7 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:47.402207 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.wsgi [None req-7f427da5-f77a-436d-ab3c-f720d2c170d7 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] HTTP exception thrown: Instance 53059fb5-bea1-4713-94dd-fb6cd8841fe9 could not be found. Jun 07 22:14:47.403849 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-7f427da5-f77a-436d-ab3c-f720d2c170d7 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Request method failure captured: Jun 07 22:14:47.403849 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: request: GET /compute/v2.1/servers/53059fb5-bea1-4713-94dd-fb6cd8841fe9 HTTP/1.1 Jun 07 22:14:47.403849 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Accept: application/json Jun 07 22:14:47.403849 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Accept-Encoding: identity Jun 07 22:14:47.403849 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Connection: close Jun 07 22:14:47.403849 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Content-Length: 0 Jun 07 22:14:47.403849 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Content-Type: application/json Jun 07 22:14:47.403849 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Host: 10.222.0.13 Jun 07 22:14:47.403849 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Openstack-System-Scope: None Jun 07 22:14:47.403849 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: User-Agent: python-urllib3/1.26.9 Jun 07 22:14:47.403849 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Auth-Token: gAAAAABin8srQLbStzUvCeAnRNadMyGlcKFPPrFg9QuKcDpjIyywTcK8viTuRoYw24qPuVh7wMg6UWBPhX8hggkc6BZRBiLlvXhF5-X03MFchuLsFFC__9JBLL5O-wkDCN77ZFc33WSFPA37h4CwlIMlU5FumSkwBM-s6ELIPTrdhu_0TKT1s2Y Jun 07 22:14:47.403849 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Domain-Id: None Jun 07 22:14:47.403849 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Domain-Name: None Jun 07 22:14:47.403849 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Identity-Status: Confirmed Jun 07 22:14:47.403849 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Is-Admin-Project: True Jun 07 22:14:47.403849 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Domain-Id: default Jun 07 22:14:47.403849 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Domain-Name: Default Jun 07 22:14:47.403849 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Id: 49d73c22e28a450a99d0952aa686dccf Jun 07 22:14:47.403849 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Name: tempest-AttachVolumeNegativeTest-1740363357 Jun 07 22:14:47.403849 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Role: member,reader Jun 07 22:14:47.403849 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Roles: member,reader Jun 07 22:14:47.405459 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/49d73c22e28a450a99d0952aa686dccf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_49d73c22e28a450a99d0952aa686dccf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/49d73c22e28a450a99d0952aa686dccf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/49d73c22e28a450a99d0952aa686dccf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}] Jun 07 22:14:47.405459 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant: tempest-AttachVolumeNegativeTest-1740363357 Jun 07 22:14:47.405459 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant-Id: 49d73c22e28a450a99d0952aa686dccf Jun 07 22:14:47.405459 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1740363357 Jun 07 22:14:47.405459 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User: tempest-AttachVolumeNegativeTest-1740363357-project Jun 07 22:14:47.405459 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Domain-Id: default Jun 07 22:14:47.405459 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Domain-Name: Default Jun 07 22:14:47.405459 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Id: 607b70b4d6e14c95ae2880dd3577c8ae Jun 07 22:14:47.405459 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Name: tempest-AttachVolumeNegativeTest-1740363357-project Jun 07 22:14:47.405459 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: method: > Jun 07 22:14:47.405459 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: exception: Instance 53059fb5-bea1-4713-94dd-fb6cd8841fe9 could not be found. Jun 07 22:14:47.405459 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: action_args: {'id': '53059fb5-bea1-4713-94dd-fb6cd8841fe9'} Jun 07 22:14:47.406373 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 22:14:47.406373 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:14:47.406373 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 22:14:47.406373 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 22:14:47.406373 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 22:14:47.406373 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 22:14:47.406373 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 22:14:47.406373 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 22:14:47.406373 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 22:14:47.406373 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 22:14:47.406373 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53059fb5-bea1-4713-94dd-fb6cd8841fe9 could not be found. Jun 07 22:14:47.406373 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:14:47.406373 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:14:47.406373 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:14:47.406373 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:14:47.406373 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:14:47.406373 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:14:47.406373 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 22:14:47.406373 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 22:14:47.406373 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 22:14:47.407925 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 22:14:47.407925 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 22:14:47.407925 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 22:14:47.407925 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 22:14:47.407925 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 22:14:47.407925 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 22:14:47.407925 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 22:14:47.407925 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53059fb5-bea1-4713-94dd-fb6cd8841fe9 could not be found. Jun 07 22:14:47.407925 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:14:47.407925 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:14:47.407925 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:14:47.407925 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:14:47.407925 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:14:47.407925 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:14:47.407925 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 22:14:47.407925 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 22:14:47.407925 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53059fb5-bea1-4713-94dd-fb6cd8841fe9 could not be found. Jun 07 22:14:47.407925 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:14:47.409907 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-7f427da5-f77a-436d-ab3c-f720d2c170d7 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Returning 404 to user: Instance 53059fb5-bea1-4713-94dd-fb6cd8841fe9 could not be found. {{(pid=117971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 22:14:47.409907 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-7f427da5-f77a-436d-ab3c-f720d2c170d7 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/53059fb5-bea1-4713-94dd-fb6cd8841fe9" status: 404 len: 111 microversion: 2.1 time: 0.028919 Jun 07 22:14:47.409907 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 672/1322] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:14:47 2022] GET /compute/v2.1/servers/53059fb5-bea1-4713-94dd-fb6cd8841fe9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 22:14:48.538272 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-4e9d109f-f012-4302-a68b-fb3cbbb29c11 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:14:48.538875 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-4e9d109f-f012-4302-a68b-fb3cbbb29c11 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 5704eeef-7ef8-4e6d-b39d-d672e9592836] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:14:48.545693 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4e9d109f-f012-4302-a68b-fb3cbbb29c11 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:48.546144 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4e9d109f-f012-4302-a68b-fb3cbbb29c11 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:48.546909 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4e9d109f-f012-4302-a68b-fb3cbbb29c11 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:48.547365 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-4e9d109f-f012-4302-a68b-fb3cbbb29c11 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:48.561846 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.wsgi [None req-4e9d109f-f012-4302-a68b-fb3cbbb29c11 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] HTTP exception thrown: Instance 5704eeef-7ef8-4e6d-b39d-d672e9592836 could not be found. Jun 07 22:14:48.563421 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-4e9d109f-f012-4302-a68b-fb3cbbb29c11 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Request method failure captured: Jun 07 22:14:48.563421 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: request: DELETE /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836 HTTP/1.1 Jun 07 22:14:48.563421 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Accept: application/json Jun 07 22:14:48.563421 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Accept-Encoding: identity Jun 07 22:14:48.563421 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Connection: close Jun 07 22:14:48.563421 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Content-Length: 0 Jun 07 22:14:48.563421 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Content-Type: application/json Jun 07 22:14:48.563421 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Host: 10.222.0.13 Jun 07 22:14:48.563421 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Openstack-System-Scope: None Jun 07 22:14:48.563421 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: User-Agent: python-urllib3/1.26.9 Jun 07 22:14:48.563421 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Auth-Token: gAAAAABin8srQLbStzUvCeAnRNadMyGlcKFPPrFg9QuKcDpjIyywTcK8viTuRoYw24qPuVh7wMg6UWBPhX8hggkc6BZRBiLlvXhF5-X03MFchuLsFFC__9JBLL5O-wkDCN77ZFc33WSFPA37h4CwlIMlU5FumSkwBM-s6ELIPTrdhu_0TKT1s2Y Jun 07 22:14:48.563421 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Domain-Id: None Jun 07 22:14:48.563421 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Domain-Name: None Jun 07 22:14:48.563421 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Identity-Status: Confirmed Jun 07 22:14:48.563421 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Is-Admin-Project: True Jun 07 22:14:48.563421 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Domain-Id: default Jun 07 22:14:48.563421 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Domain-Name: Default Jun 07 22:14:48.563421 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Id: 49d73c22e28a450a99d0952aa686dccf Jun 07 22:14:48.563421 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Name: tempest-AttachVolumeNegativeTest-1740363357 Jun 07 22:14:48.563421 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Role: member,reader Jun 07 22:14:48.563421 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Roles: member,reader Jun 07 22:14:48.565083 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/49d73c22e28a450a99d0952aa686dccf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_49d73c22e28a450a99d0952aa686dccf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/49d73c22e28a450a99d0952aa686dccf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/49d73c22e28a450a99d0952aa686dccf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}] Jun 07 22:14:48.565083 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Tenant: tempest-AttachVolumeNegativeTest-1740363357 Jun 07 22:14:48.565083 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Tenant-Id: 49d73c22e28a450a99d0952aa686dccf Jun 07 22:14:48.565083 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1740363357 Jun 07 22:14:48.565083 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User: tempest-AttachVolumeNegativeTest-1740363357-project Jun 07 22:14:48.565083 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Domain-Id: default Jun 07 22:14:48.565083 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Domain-Name: Default Jun 07 22:14:48.565083 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Id: 607b70b4d6e14c95ae2880dd3577c8ae Jun 07 22:14:48.565083 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Name: tempest-AttachVolumeNegativeTest-1740363357-project Jun 07 22:14:48.565083 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: method: > Jun 07 22:14:48.565083 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: exception: Instance 5704eeef-7ef8-4e6d-b39d-d672e9592836 could not be found. Jun 07 22:14:48.565083 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: action_args: {'id': '5704eeef-7ef8-4e6d-b39d-d672e9592836'} Jun 07 22:14:48.565939 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 22:14:48.565939 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:14:48.565939 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 22:14:48.565939 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 22:14:48.565939 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 22:14:48.565939 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 22:14:48.565939 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 22:14:48.565939 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 22:14:48.565939 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 22:14:48.565939 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 22:14:48.565939 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5704eeef-7ef8-4e6d-b39d-d672e9592836 could not be found. Jun 07 22:14:48.565939 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:14:48.565939 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:14:48.565939 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:14:48.565939 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:14:48.565939 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:14:48.565939 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:14:48.565939 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 22:14:48.565939 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 22:14:48.565939 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 22:14:48.567417 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 22:14:48.567417 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 22:14:48.567417 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 22:14:48.567417 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 22:14:48.567417 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 22:14:48.567417 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 22:14:48.567417 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 22:14:48.567417 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 22:14:48.567417 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 22:14:48.567417 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5704eeef-7ef8-4e6d-b39d-d672e9592836 could not be found. Jun 07 22:14:48.567417 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:14:48.567417 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:14:48.567417 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:14:48.567417 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:14:48.567417 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:14:48.567417 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:14:48.567417 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 22:14:48.567417 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 22:14:48.567417 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5704eeef-7ef8-4e6d-b39d-d672e9592836 could not be found. Jun 07 22:14:48.567417 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:14:48.568912 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-4e9d109f-f012-4302-a68b-fb3cbbb29c11 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Returning 404 to user: Instance 5704eeef-7ef8-4e6d-b39d-d672e9592836 could not be found. {{(pid=117970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 22:14:48.568912 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-4e9d109f-f012-4302-a68b-fb3cbbb29c11 tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "DELETE /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836" status: 404 len: 111 microversion: 2.1 time: 0.031208 Jun 07 22:14:48.568912 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 651/1323] 10.222.0.13 () {58 vars in 1238 bytes} [Tue Jun 7 22:14:48 2022] DELETE /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 22:14:48.573666 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-25bb4d96-daf0-4e4f-a3d9-60e271ac680c tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:14:48.574806 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-25bb4d96-daf0-4e4f-a3d9-60e271ac680c tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] [instance: 5704eeef-7ef8-4e6d-b39d-d672e9592836] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:14:48.581305 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-25bb4d96-daf0-4e4f-a3d9-60e271ac680c tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:48.581896 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-25bb4d96-daf0-4e4f-a3d9-60e271ac680c tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:48.582843 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-25bb4d96-daf0-4e4f-a3d9-60e271ac680c tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:14:48.583288 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-25bb4d96-daf0-4e4f-a3d9-60e271ac680c tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:14:48.596945 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.wsgi [None req-25bb4d96-daf0-4e4f-a3d9-60e271ac680c tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] HTTP exception thrown: Instance 5704eeef-7ef8-4e6d-b39d-d672e9592836 could not be found. Jun 07 22:14:48.599282 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-25bb4d96-daf0-4e4f-a3d9-60e271ac680c tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Request method failure captured: Jun 07 22:14:48.599282 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: request: GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836 HTTP/1.1 Jun 07 22:14:48.599282 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Accept: application/json Jun 07 22:14:48.599282 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Accept-Encoding: identity Jun 07 22:14:48.599282 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Connection: close Jun 07 22:14:48.599282 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Content-Length: 0 Jun 07 22:14:48.599282 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Content-Type: application/json Jun 07 22:14:48.599282 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Host: 10.222.0.13 Jun 07 22:14:48.599282 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Openstack-System-Scope: None Jun 07 22:14:48.599282 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: User-Agent: python-urllib3/1.26.9 Jun 07 22:14:48.599282 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Auth-Token: gAAAAABin8srQLbStzUvCeAnRNadMyGlcKFPPrFg9QuKcDpjIyywTcK8viTuRoYw24qPuVh7wMg6UWBPhX8hggkc6BZRBiLlvXhF5-X03MFchuLsFFC__9JBLL5O-wkDCN77ZFc33WSFPA37h4CwlIMlU5FumSkwBM-s6ELIPTrdhu_0TKT1s2Y Jun 07 22:14:48.599282 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Domain-Id: None Jun 07 22:14:48.599282 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Domain-Name: None Jun 07 22:14:48.599282 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Identity-Status: Confirmed Jun 07 22:14:48.599282 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Is-Admin-Project: True Jun 07 22:14:48.599282 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Domain-Id: default Jun 07 22:14:48.599282 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Domain-Name: Default Jun 07 22:14:48.599282 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Id: 49d73c22e28a450a99d0952aa686dccf Jun 07 22:14:48.599282 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Name: tempest-AttachVolumeNegativeTest-1740363357 Jun 07 22:14:48.599282 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Role: member,reader Jun 07 22:14:48.599282 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Roles: member,reader Jun 07 22:14:48.600993 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/49d73c22e28a450a99d0952aa686dccf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_49d73c22e28a450a99d0952aa686dccf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/49d73c22e28a450a99d0952aa686dccf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/49d73c22e28a450a99d0952aa686dccf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}] Jun 07 22:14:48.600993 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant: tempest-AttachVolumeNegativeTest-1740363357 Jun 07 22:14:48.600993 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant-Id: 49d73c22e28a450a99d0952aa686dccf Jun 07 22:14:48.600993 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1740363357 Jun 07 22:14:48.600993 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User: tempest-AttachVolumeNegativeTest-1740363357-project Jun 07 22:14:48.600993 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Domain-Id: default Jun 07 22:14:48.600993 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Domain-Name: Default Jun 07 22:14:48.600993 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Id: 607b70b4d6e14c95ae2880dd3577c8ae Jun 07 22:14:48.600993 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Name: tempest-AttachVolumeNegativeTest-1740363357-project Jun 07 22:14:48.600993 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: method: > Jun 07 22:14:48.600993 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: exception: Instance 5704eeef-7ef8-4e6d-b39d-d672e9592836 could not be found. Jun 07 22:14:48.600993 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: action_args: {'id': '5704eeef-7ef8-4e6d-b39d-d672e9592836'} Jun 07 22:14:48.605433 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 22:14:48.605433 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:14:48.605433 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 22:14:48.605433 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 22:14:48.605433 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 22:14:48.605433 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 22:14:48.605433 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 22:14:48.605433 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 22:14:48.605433 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 22:14:48.605433 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 22:14:48.605433 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5704eeef-7ef8-4e6d-b39d-d672e9592836 could not be found. Jun 07 22:14:48.605433 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:14:48.605433 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:14:48.605433 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:14:48.605433 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:14:48.605433 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:14:48.605433 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:14:48.605433 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 22:14:48.605433 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 22:14:48.605433 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 22:14:48.607406 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 22:14:48.607406 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 22:14:48.607406 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 22:14:48.607406 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 22:14:48.607406 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 22:14:48.607406 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 22:14:48.607406 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 22:14:48.607406 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5704eeef-7ef8-4e6d-b39d-d672e9592836 could not be found. Jun 07 22:14:48.607406 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:14:48.607406 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:14:48.607406 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:14:48.607406 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:14:48.607406 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:14:48.607406 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:14:48.607406 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 22:14:48.607406 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 22:14:48.607406 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5704eeef-7ef8-4e6d-b39d-d672e9592836 could not be found. Jun 07 22:14:48.607406 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:14:48.608772 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-25bb4d96-daf0-4e4f-a3d9-60e271ac680c tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] Returning 404 to user: Instance 5704eeef-7ef8-4e6d-b39d-d672e9592836 could not be found. {{(pid=117971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 22:14:48.608772 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-25bb4d96-daf0-4e4f-a3d9-60e271ac680c tempest-AttachVolumeNegativeTest-1740363357 tempest-AttachVolumeNegativeTest-1740363357-project] 10.222.0.13 "GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836" status: 404 len: 111 microversion: 2.1 time: 0.031112 Jun 07 22:14:48.608772 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 673/1324] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:14:48 2022] GET /compute/v2.1/servers/5704eeef-7ef8-4e6d-b39d-d672e9592836 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 22:15:22.028340 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-777a8d5a-d73f-4b43-ab06-852e2ca5201f tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:22.029255 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-777a8d5a-d73f-4b43-ab06-852e2ca5201f tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: cddfb0ad-63f6-4b0d-bf12-d388bfb0714c] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:15:22.031496 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:15:22.032294 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:15:22.039070 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-777a8d5a-d73f-4b43-ab06-852e2ca5201f tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:22.039550 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-777a8d5a-d73f-4b43-ab06-852e2ca5201f tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:22.040318 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-777a8d5a-d73f-4b43-ab06-852e2ca5201f tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:22.040751 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-777a8d5a-d73f-4b43-ab06-852e2ca5201f tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:22.071549 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-777a8d5a-d73f-4b43-ab06-852e2ca5201f tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047251 Jun 07 22:15:22.072112 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 652/1325] 10.222.0.13 () {60 vars in 1342 bytes} [Tue Jun 7 22:15:22 2022] GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:15:22.129412 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-cbb6f394-4959-4c75-a802-81aac82bcdad tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:22.130090 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-cbb6f394-4959-4c75-a802-81aac82bcdad tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: cddfb0ad-63f6-4b0d-bf12-d388bfb0714c] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:15:22.132463 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:15:22.133263 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_cell1:SELECT=37,nova_cell1:INSERT=1 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:15:22.139511 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-cbb6f394-4959-4c75-a802-81aac82bcdad tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:22.140041 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-cbb6f394-4959-4c75-a802-81aac82bcdad tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:22.140882 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-cbb6f394-4959-4c75-a802-81aac82bcdad tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:22.141361 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-cbb6f394-4959-4c75-a802-81aac82bcdad tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:22.169183 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-cbb6f394-4959-4c75-a802-81aac82bcdad tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: cddfb0ad-63f6-4b0d-bf12-d388bfb0714c] Going to try to terminate instance {{(pid=117971) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 22:15:22.247144 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-cbb6f394-4959-4c75-a802-81aac82bcdad tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "DELETE /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c" status: 204 len: 0 microversion: 2.20 time: 0.121621 Jun 07 22:15:22.247811 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 674/1326] 10.222.0.13 () {60 vars in 1279 bytes} [Tue Jun 7 22:15:22 2022] DELETE /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 07 22:15:22.257464 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-e5a736fe-6b1f-4888-a665-168bed8f7594 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:22.258077 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-e5a736fe-6b1f-4888-a665-168bed8f7594 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: cddfb0ad-63f6-4b0d-bf12-d388bfb0714c] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:15:22.264277 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e5a736fe-6b1f-4888-a665-168bed8f7594 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:22.264736 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e5a736fe-6b1f-4888-a665-168bed8f7594 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:22.265494 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e5a736fe-6b1f-4888-a665-168bed8f7594 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:22.265933 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e5a736fe-6b1f-4888-a665-168bed8f7594 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:22.398537 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-e5a736fe-6b1f-4888-a665-168bed8f7594 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:15:22.406430 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-e5a736fe-6b1f-4888-a665-168bed8f7594 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:15:22.407971 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-e5a736fe-6b1f-4888-a665-168bed8f7594 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:15:22.409319 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-e5a736fe-6b1f-4888-a665-168bed8f7594 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c" status: 200 len: 1723 microversion: 2.20 time: 0.157001 Jun 07 22:15:22.409864 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 653/1327] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:15:22 2022] GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 22:15:23.428076 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-c836be6e-d235-4322-a09a-93926e507c79 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:23.428874 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-c836be6e-d235-4322-a09a-93926e507c79 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: cddfb0ad-63f6-4b0d-bf12-d388bfb0714c] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:15:23.435316 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c836be6e-d235-4322-a09a-93926e507c79 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:23.435796 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c836be6e-d235-4322-a09a-93926e507c79 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:23.436557 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c836be6e-d235-4322-a09a-93926e507c79 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:23.436990 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-c836be6e-d235-4322-a09a-93926e507c79 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:23.575218 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-c836be6e-d235-4322-a09a-93926e507c79 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:15:23.583805 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-c836be6e-d235-4322-a09a-93926e507c79 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:15:23.585313 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-c836be6e-d235-4322-a09a-93926e507c79 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:15:23.586502 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-c836be6e-d235-4322-a09a-93926e507c79 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c" status: 200 len: 1723 microversion: 2.20 time: 0.162874 Jun 07 22:15:23.587050 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 675/1328] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:15:23 2022] GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:15:24.100069 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-03566778-228a-49f3-99a9-707c4d2ee0c0 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:15:24.100629 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-03566778-228a-49f3-99a9-707c4d2ee0c0 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] [instance: 4d8ab38f-db6d-4560-962e-c1e55c509ce1] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:15:24.107513 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-03566778-228a-49f3-99a9-707c4d2ee0c0 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:24.107964 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-03566778-228a-49f3-99a9-707c4d2ee0c0 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:24.108729 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-03566778-228a-49f3-99a9-707c4d2ee0c0 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:24.109163 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-03566778-228a-49f3-99a9-707c4d2ee0c0 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:24.132895 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.objects.instance [None req-03566778-228a-49f3-99a9-707c4d2ee0c0 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lazy-loading 'flavor' on Instance uuid 4d8ab38f-db6d-4560-962e-c1e55c509ce1 {{(pid=117970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 22:15:24.203824 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-03566778-228a-49f3-99a9-707c4d2ee0c0 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] 10.222.0.13 "POST /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1/action" status: 202 len: 0 microversion: 2.1 time: 0.107474 Jun 07 22:15:24.204393 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 654/1329] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Jun 7 22:15:24 2022] POST /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 22:15:24.212737 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-a32cd479-ae55-42de-bb98-44b763d47e2e tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:24.213339 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-a32cd479-ae55-42de-bb98-44b763d47e2e tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] [instance: 4d8ab38f-db6d-4560-962e-c1e55c509ce1] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:15:24.219385 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a32cd479-ae55-42de-bb98-44b763d47e2e tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:24.219827 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a32cd479-ae55-42de-bb98-44b763d47e2e tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:24.220567 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a32cd479-ae55-42de-bb98-44b763d47e2e tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:24.220993 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a32cd479-ae55-42de-bb98-44b763d47e2e tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:24.353529 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-a32cd479-ae55-42de-bb98-44b763d47e2e tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e8c46b1820a4ce5ac853ab1cc88fc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98914183afee4e58ad7a425cb019e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:15:24.360985 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-a32cd479-ae55-42de-bb98-44b763d47e2e tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] 10.222.0.13 "GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1" status: 200 len: 1569 microversion: 2.1 time: 0.152075 Jun 07 22:15:24.361540 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 676/1330] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:15:24 2022] GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:15:24.605569 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-17e33a60-a85f-4520-a749-6bde3e6c2c81 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:24.606167 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-17e33a60-a85f-4520-a749-6bde3e6c2c81 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: cddfb0ad-63f6-4b0d-bf12-d388bfb0714c] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:15:24.615510 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-17e33a60-a85f-4520-a749-6bde3e6c2c81 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:24.616214 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-17e33a60-a85f-4520-a749-6bde3e6c2c81 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:24.616990 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-17e33a60-a85f-4520-a749-6bde3e6c2c81 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:24.617434 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-17e33a60-a85f-4520-a749-6bde3e6c2c81 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:24.752016 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-17e33a60-a85f-4520-a749-6bde3e6c2c81 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:15:24.760443 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-17e33a60-a85f-4520-a749-6bde3e6c2c81 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:15:24.761648 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-17e33a60-a85f-4520-a749-6bde3e6c2c81 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:15:24.762805 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-17e33a60-a85f-4520-a749-6bde3e6c2c81 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c" status: 200 len: 1723 microversion: 2.20 time: 0.161921 Jun 07 22:15:24.763387 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 655/1331] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:15:24 2022] GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:15:25.379227 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-b76e8512-d072-404c-9ffd-7a42489209b3 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:25.379859 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-b76e8512-d072-404c-9ffd-7a42489209b3 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] [instance: 4d8ab38f-db6d-4560-962e-c1e55c509ce1] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:15:25.386368 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b76e8512-d072-404c-9ffd-7a42489209b3 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:25.386810 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b76e8512-d072-404c-9ffd-7a42489209b3 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:25.387605 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b76e8512-d072-404c-9ffd-7a42489209b3 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:25.388035 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-b76e8512-d072-404c-9ffd-7a42489209b3 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:25.520913 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-b76e8512-d072-404c-9ffd-7a42489209b3 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e8c46b1820a4ce5ac853ab1cc88fc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98914183afee4e58ad7a425cb019e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:15:25.528277 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-b76e8512-d072-404c-9ffd-7a42489209b3 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] 10.222.0.13 "GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1" status: 200 len: 1569 microversion: 2.1 time: 0.153440 Jun 07 22:15:25.528840 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 677/1332] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:15:25 2022] GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:15:25.784557 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-25169d4a-63c5-462c-9e76-54e5dc13795f tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:25.785366 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-25169d4a-63c5-462c-9e76-54e5dc13795f tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: cddfb0ad-63f6-4b0d-bf12-d388bfb0714c] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:15:25.793313 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-25169d4a-63c5-462c-9e76-54e5dc13795f tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:25.794498 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-25169d4a-63c5-462c-9e76-54e5dc13795f tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:25.795893 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-25169d4a-63c5-462c-9e76-54e5dc13795f tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:25.796365 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-25169d4a-63c5-462c-9e76-54e5dc13795f tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:25.928344 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-25169d4a-63c5-462c-9e76-54e5dc13795f tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:15:25.936180 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-25169d4a-63c5-462c-9e76-54e5dc13795f tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:15:25.937658 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-25169d4a-63c5-462c-9e76-54e5dc13795f tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:15:25.938796 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-25169d4a-63c5-462c-9e76-54e5dc13795f tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c" status: 200 len: 1723 microversion: 2.20 time: 0.161350 Jun 07 22:15:25.939367 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 656/1333] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:15:25 2022] GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:15:26.546593 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-6800be58-5e08-4fb5-8427-ea0631e09d73 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:26.547210 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-6800be58-5e08-4fb5-8427-ea0631e09d73 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] [instance: 4d8ab38f-db6d-4560-962e-c1e55c509ce1] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:15:26.553731 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-6800be58-5e08-4fb5-8427-ea0631e09d73 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:26.554172 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-6800be58-5e08-4fb5-8427-ea0631e09d73 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:26.554921 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-6800be58-5e08-4fb5-8427-ea0631e09d73 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:26.555735 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-6800be58-5e08-4fb5-8427-ea0631e09d73 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:26.683934 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-6800be58-5e08-4fb5-8427-ea0631e09d73 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e8c46b1820a4ce5ac853ab1cc88fc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98914183afee4e58ad7a425cb019e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:15:26.691894 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-6800be58-5e08-4fb5-8427-ea0631e09d73 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] 10.222.0.13 "GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1" status: 200 len: 1569 microversion: 2.1 time: 0.149151 Jun 07 22:15:26.692456 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 678/1334] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:15:26 2022] GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:15:26.956621 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-24e50b16-5e8d-4e23-a9d7-0ab2df40c499 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:26.957150 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-24e50b16-5e8d-4e23-a9d7-0ab2df40c499 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: cddfb0ad-63f6-4b0d-bf12-d388bfb0714c] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:15:26.963595 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-24e50b16-5e8d-4e23-a9d7-0ab2df40c499 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:26.964048 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-24e50b16-5e8d-4e23-a9d7-0ab2df40c499 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:26.964799 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-24e50b16-5e8d-4e23-a9d7-0ab2df40c499 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:26.965237 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-24e50b16-5e8d-4e23-a9d7-0ab2df40c499 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:27.093799 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-24e50b16-5e8d-4e23-a9d7-0ab2df40c499 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:15:27.101783 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-24e50b16-5e8d-4e23-a9d7-0ab2df40c499 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:15:27.103555 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-24e50b16-5e8d-4e23-a9d7-0ab2df40c499 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:15:27.104704 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-24e50b16-5e8d-4e23-a9d7-0ab2df40c499 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c" status: 200 len: 1723 microversion: 2.20 time: 0.152118 Jun 07 22:15:27.105438 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 657/1335] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:15:26 2022] GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:15:27.709271 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-e8afa1b9-89fb-4afa-9e1d-2e312da8c8db tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:27.709882 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-e8afa1b9-89fb-4afa-9e1d-2e312da8c8db tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] [instance: 4d8ab38f-db6d-4560-962e-c1e55c509ce1] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:15:27.716286 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e8afa1b9-89fb-4afa-9e1d-2e312da8c8db tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:27.716735 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e8afa1b9-89fb-4afa-9e1d-2e312da8c8db tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:27.717488 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e8afa1b9-89fb-4afa-9e1d-2e312da8c8db tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:27.717927 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e8afa1b9-89fb-4afa-9e1d-2e312da8c8db tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:27.846918 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-e8afa1b9-89fb-4afa-9e1d-2e312da8c8db tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e8c46b1820a4ce5ac853ab1cc88fc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98914183afee4e58ad7a425cb019e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:15:27.859034 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-e8afa1b9-89fb-4afa-9e1d-2e312da8c8db tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] 10.222.0.13 "GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1" status: 200 len: 1569 microversion: 2.1 time: 0.154047 Jun 07 22:15:27.859641 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 679/1336] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:15:27 2022] GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:15:28.123573 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-1b4d030e-f18d-46bf-84ba-5bb732941176 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:28.124172 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-1b4d030e-f18d-46bf-84ba-5bb732941176 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: cddfb0ad-63f6-4b0d-bf12-d388bfb0714c] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:15:28.133708 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1b4d030e-f18d-46bf-84ba-5bb732941176 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:28.134468 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1b4d030e-f18d-46bf-84ba-5bb732941176 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:28.134902 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1b4d030e-f18d-46bf-84ba-5bb732941176 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:28.135351 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1b4d030e-f18d-46bf-84ba-5bb732941176 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:28.377250 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-1b4d030e-f18d-46bf-84ba-5bb732941176 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:15:28.390347 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-1b4d030e-f18d-46bf-84ba-5bb732941176 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:15:28.394104 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-1b4d030e-f18d-46bf-84ba-5bb732941176 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:15:28.395359 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-1b4d030e-f18d-46bf-84ba-5bb732941176 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c" status: 200 len: 1723 microversion: 2.20 time: 0.275745 Jun 07 22:15:28.396968 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 658/1337] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:15:28 2022] GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c => generated 1723 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:15:28.876912 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-99a5acad-cd82-4d32-9efb-2b3ae991e3cb tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:28.877611 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-99a5acad-cd82-4d32-9efb-2b3ae991e3cb tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] [instance: 4d8ab38f-db6d-4560-962e-c1e55c509ce1] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:15:28.884074 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-99a5acad-cd82-4d32-9efb-2b3ae991e3cb tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:28.884521 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-99a5acad-cd82-4d32-9efb-2b3ae991e3cb tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:28.885318 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-99a5acad-cd82-4d32-9efb-2b3ae991e3cb tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:28.885752 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-99a5acad-cd82-4d32-9efb-2b3ae991e3cb tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:29.026556 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-99a5acad-cd82-4d32-9efb-2b3ae991e3cb tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e8c46b1820a4ce5ac853ab1cc88fc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98914183afee4e58ad7a425cb019e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:15:29.034980 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-99a5acad-cd82-4d32-9efb-2b3ae991e3cb tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] 10.222.0.13 "GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1" status: 200 len: 1569 microversion: 2.1 time: 0.162024 Jun 07 22:15:29.035585 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 680/1338] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:15:28 2022] GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:15:29.401339 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [req-4292e252-cc6f-4b74-8fc0-6bc38f71edfe req-9cd2e3fd-01cf-4530-aa1d-5c89ff1912bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cddfb0ad-63f6-4b0d-bf12-d388bfb0714c", "name": "network-vif-deleted", "tag": "e1237eb4-3f3b-48bf-97bb-9e2c3cfc48b3"}]} {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:15:29.416335 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-2af35251-c1b5-4424-8779-8ae7c3fe8383 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:29.417343 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-2af35251-c1b5-4424-8779-8ae7c3fe8383 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: cddfb0ad-63f6-4b0d-bf12-d388bfb0714c] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:15:29.424885 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-2af35251-c1b5-4424-8779-8ae7c3fe8383 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:29.425378 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [req-4292e252-cc6f-4b74-8fc0-6bc38f71edfe req-9cd2e3fd-01cf-4530-aa1d-5c89ff1912bf service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:29.426020 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [req-4292e252-cc6f-4b74-8fc0-6bc38f71edfe req-9cd2e3fd-01cf-4530-aa1d-5c89ff1912bf service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:29.429010 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-2af35251-c1b5-4424-8779-8ae7c3fe8383 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:29.429836 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-2af35251-c1b5-4424-8779-8ae7c3fe8383 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:29.430272 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-2af35251-c1b5-4424-8779-8ae7c3fe8383 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:29.453555 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.compute.server_external_events [req-4292e252-cc6f-4b74-8fc0-6bc38f71edfe req-9cd2e3fd-01cf-4530-aa1d-5c89ff1912bf service nova] Creating event network-vif-deleted:e1237eb4-3f3b-48bf-97bb-9e2c3cfc48b3 for instance cddfb0ad-63f6-4b0d-bf12-d388bfb0714c on hv-cinder-83552 Jun 07 22:15:29.460195 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [req-4292e252-cc6f-4b74-8fc0-6bc38f71edfe req-9cd2e3fd-01cf-4530-aa1d-5c89ff1912bf service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.257152 Jun 07 22:15:29.462424 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 659/1339] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:15:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:15:29.551054 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-2af35251-c1b5-4424-8779-8ae7c3fe8383 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:15:29.559811 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-2af35251-c1b5-4424-8779-8ae7c3fe8383 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:15:29.561346 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-2af35251-c1b5-4424-8779-8ae7c3fe8383 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:15:29.562532 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-2af35251-c1b5-4424-8779-8ae7c3fe8383 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c" status: 200 len: 1656 microversion: 2.20 time: 0.150056 Jun 07 22:15:29.563101 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 681/1340] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:15:29 2022] GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c => generated 1656 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:15:30.052747 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-1e5f7311-e5a2-424e-9adb-27f6aa9901d9 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:30.053430 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-1e5f7311-e5a2-424e-9adb-27f6aa9901d9 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] [instance: 4d8ab38f-db6d-4560-962e-c1e55c509ce1] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:15:30.059841 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1e5f7311-e5a2-424e-9adb-27f6aa9901d9 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:30.060285 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1e5f7311-e5a2-424e-9adb-27f6aa9901d9 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:30.061047 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1e5f7311-e5a2-424e-9adb-27f6aa9901d9 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:30.061478 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1e5f7311-e5a2-424e-9adb-27f6aa9901d9 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:30.208891 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-1e5f7311-e5a2-424e-9adb-27f6aa9901d9 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e8c46b1820a4ce5ac853ab1cc88fc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98914183afee4e58ad7a425cb019e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:15:30.217063 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-1e5f7311-e5a2-424e-9adb-27f6aa9901d9 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] 10.222.0.13 "GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1" status: 200 len: 1569 microversion: 2.1 time: 0.168925 Jun 07 22:15:30.217641 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 660/1341] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:15:30 2022] GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1 => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:15:30.581981 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-87ff55ce-6175-4f6f-92ae-3adec46414a6 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:30.582540 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-87ff55ce-6175-4f6f-92ae-3adec46414a6 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: cddfb0ad-63f6-4b0d-bf12-d388bfb0714c] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:15:30.589242 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-87ff55ce-6175-4f6f-92ae-3adec46414a6 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:30.589694 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-87ff55ce-6175-4f6f-92ae-3adec46414a6 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:30.590451 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-87ff55ce-6175-4f6f-92ae-3adec46414a6 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:30.590883 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-87ff55ce-6175-4f6f-92ae-3adec46414a6 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:30.652640 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-87ff55ce-6175-4f6f-92ae-3adec46414a6 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:15:30.660803 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-87ff55ce-6175-4f6f-92ae-3adec46414a6 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:15:30.662283 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-87ff55ce-6175-4f6f-92ae-3adec46414a6 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:15:30.663422 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-87ff55ce-6175-4f6f-92ae-3adec46414a6 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c" status: 200 len: 1366 microversion: 2.20 time: 0.086158 Jun 07 22:15:30.663976 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 682/1342] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:15:30 2022] GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c => generated 1366 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 22:15:31.234845 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-1f9a3347-4b03-4625-9703-cf3ccbfd6404 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:31.235464 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-1f9a3347-4b03-4625-9703-cf3ccbfd6404 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] [instance: 4d8ab38f-db6d-4560-962e-c1e55c509ce1] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:15:31.242627 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1f9a3347-4b03-4625-9703-cf3ccbfd6404 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:31.243069 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1f9a3347-4b03-4625-9703-cf3ccbfd6404 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:31.243840 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1f9a3347-4b03-4625-9703-cf3ccbfd6404 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:31.244269 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-1f9a3347-4b03-4625-9703-cf3ccbfd6404 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:31.372883 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-1f9a3347-4b03-4625-9703-cf3ccbfd6404 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e8c46b1820a4ce5ac853ab1cc88fc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98914183afee4e58ad7a425cb019e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:15:31.380542 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-1f9a3347-4b03-4625-9703-cf3ccbfd6404 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] 10.222.0.13 "GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1" status: 200 len: 1569 microversion: 2.1 time: 0.149586 Jun 07 22:15:31.381101 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 661/1343] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:15:31 2022] GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:15:31.680963 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-e65b6327-5dfb-45ac-9bab-0fc309be5c84 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:31.681571 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-e65b6327-5dfb-45ac-9bab-0fc309be5c84 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: cddfb0ad-63f6-4b0d-bf12-d388bfb0714c] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:15:31.687991 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e65b6327-5dfb-45ac-9bab-0fc309be5c84 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:31.688435 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e65b6327-5dfb-45ac-9bab-0fc309be5c84 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:31.689184 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e65b6327-5dfb-45ac-9bab-0fc309be5c84 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:31.689618 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e65b6327-5dfb-45ac-9bab-0fc309be5c84 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:31.753498 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-e65b6327-5dfb-45ac-9bab-0fc309be5c84 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:15:31.761525 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-e65b6327-5dfb-45ac-9bab-0fc309be5c84 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:15:31.763048 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-e65b6327-5dfb-45ac-9bab-0fc309be5c84 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:15:31.764208 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-e65b6327-5dfb-45ac-9bab-0fc309be5c84 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c" status: 200 len: 1366 microversion: 2.20 time: 0.087093 Jun 07 22:15:31.764768 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 683/1344] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:15:31 2022] GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c => generated 1366 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:15:32.396757 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-3cac0058-e27a-4b61-a8e8-6973315aa60a tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:32.397364 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-3cac0058-e27a-4b61-a8e8-6973315aa60a tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] [instance: 4d8ab38f-db6d-4560-962e-c1e55c509ce1] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:15:32.403976 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-3cac0058-e27a-4b61-a8e8-6973315aa60a tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:32.404421 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-3cac0058-e27a-4b61-a8e8-6973315aa60a tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:32.405168 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-3cac0058-e27a-4b61-a8e8-6973315aa60a tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:32.405601 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-3cac0058-e27a-4b61-a8e8-6973315aa60a tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:32.535358 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-3cac0058-e27a-4b61-a8e8-6973315aa60a tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e8c46b1820a4ce5ac853ab1cc88fc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98914183afee4e58ad7a425cb019e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:15:32.542815 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-3cac0058-e27a-4b61-a8e8-6973315aa60a tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] 10.222.0.13 "GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1" status: 200 len: 1569 microversion: 2.1 time: 0.149955 Jun 07 22:15:32.543382 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 662/1345] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:15:32 2022] GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:15:32.782121 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-6d09f0c4-b74c-4f2b-9b37-e26ea86cbd0e tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:32.782734 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-6d09f0c4-b74c-4f2b-9b37-e26ea86cbd0e tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: cddfb0ad-63f6-4b0d-bf12-d388bfb0714c] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:15:32.790054 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-6d09f0c4-b74c-4f2b-9b37-e26ea86cbd0e tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:32.790526 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-6d09f0c4-b74c-4f2b-9b37-e26ea86cbd0e tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:32.791280 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-6d09f0c4-b74c-4f2b-9b37-e26ea86cbd0e tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:32.791735 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-6d09f0c4-b74c-4f2b-9b37-e26ea86cbd0e tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:32.822588 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-6d09f0c4-b74c-4f2b-9b37-e26ea86cbd0e tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:32.823030 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-6d09f0c4-b74c-4f2b-9b37-e26ea86cbd0e tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:32.823518 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.objects.instance [None req-6d09f0c4-b74c-4f2b-9b37-e26ea86cbd0e tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lazy-loading 'fault' on Instance uuid cddfb0ad-63f6-4b0d-bf12-d388bfb0714c {{(pid=117971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 22:15:32.864480 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-6d09f0c4-b74c-4f2b-9b37-e26ea86cbd0e tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:15:32.872359 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-6d09f0c4-b74c-4f2b-9b37-e26ea86cbd0e tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:15:32.873860 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-6d09f0c4-b74c-4f2b-9b37-e26ea86cbd0e tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de021dc74a4446d8b6a63883fd56a7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0ee4be50354a20baf5af85aeb4c3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:15:32.874999 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-6d09f0c4-b74c-4f2b-9b37-e26ea86cbd0e tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c" status: 200 len: 1371 microversion: 2.20 time: 0.096862 Jun 07 22:15:32.875592 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 684/1346] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:15:32 2022] GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c => generated 1371 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 22:15:33.560324 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-ed35e631-5a14-4961-8916-a3a188149b6d tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:33.560937 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-ed35e631-5a14-4961-8916-a3a188149b6d tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] [instance: 4d8ab38f-db6d-4560-962e-c1e55c509ce1] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:15:33.568771 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-ed35e631-5a14-4961-8916-a3a188149b6d tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:33.569221 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-ed35e631-5a14-4961-8916-a3a188149b6d tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:33.570008 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-ed35e631-5a14-4961-8916-a3a188149b6d tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:33.570447 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-ed35e631-5a14-4961-8916-a3a188149b6d tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:33.710653 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-ed35e631-5a14-4961-8916-a3a188149b6d tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e8c46b1820a4ce5ac853ab1cc88fc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98914183afee4e58ad7a425cb019e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:15:33.718294 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-ed35e631-5a14-4961-8916-a3a188149b6d tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] 10.222.0.13 "GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1" status: 200 len: 1569 microversion: 2.1 time: 0.161829 Jun 07 22:15:33.718872 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 663/1347] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:15:33 2022] GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:15:33.892927 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-0e88f777-ddd8-4238-a0ea-9be0bc4971c3 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:33.893605 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-0e88f777-ddd8-4238-a0ea-9be0bc4971c3 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: cddfb0ad-63f6-4b0d-bf12-d388bfb0714c] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:15:33.900197 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-0e88f777-ddd8-4238-a0ea-9be0bc4971c3 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:33.900434 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-0e88f777-ddd8-4238-a0ea-9be0bc4971c3 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:33.901194 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-0e88f777-ddd8-4238-a0ea-9be0bc4971c3 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:33.901597 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-0e88f777-ddd8-4238-a0ea-9be0bc4971c3 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:33.914907 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.wsgi [None req-0e88f777-ddd8-4238-a0ea-9be0bc4971c3 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] HTTP exception thrown: Instance cddfb0ad-63f6-4b0d-bf12-d388bfb0714c could not be found. Jun 07 22:15:33.916571 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-0e88f777-ddd8-4238-a0ea-9be0bc4971c3 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Request method failure captured: Jun 07 22:15:33.916571 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: request: GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c HTTP/1.1 Jun 07 22:15:33.916571 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Accept: application/json Jun 07 22:15:33.916571 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Accept-Encoding: identity Jun 07 22:15:33.916571 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Connection: close Jun 07 22:15:33.916571 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Content-Length: 0 Jun 07 22:15:33.916571 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Content-Type: application/json Jun 07 22:15:33.916571 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Host: 10.222.0.13 Jun 07 22:15:33.916571 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Openstack-System-Scope: None Jun 07 22:15:33.916571 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: User-Agent: python-urllib3/1.26.9 Jun 07 22:15:33.916571 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Auth-Token: gAAAAABin8uPjY2n2U1UfD4BAC2BIPUnwdSjtmQlXMcGhyJKVuNwqCxKLwue5dUbR_nnn0f1dXWMonXAfPVmaYaFFK195PB3zvnPxXy5QcfNuc_jj0zriGmy8yorTG8wSIV834eMYCFSAP3BcLoYzwSynfDxfY2lVxuTIQljKk3LHvbzv2JrNjM Jun 07 22:15:33.916571 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Domain-Id: None Jun 07 22:15:33.916571 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Domain-Name: None Jun 07 22:15:33.916571 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Identity-Status: Confirmed Jun 07 22:15:33.916571 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Is-Admin-Project: True Jun 07 22:15:33.916571 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Openstack-Nova-Api-Version: 2.20 Jun 07 22:15:33.916571 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Domain-Id: default Jun 07 22:15:33.916571 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Domain-Name: Default Jun 07 22:15:33.916571 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Id: 9f0ee4be50354a20baf5af85aeb4c3b2 Jun 07 22:15:33.916571 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1012893920 Jun 07 22:15:33.916571 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Role: member,reader Jun 07 22:15:33.916571 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Roles: member,reader Jun 07 22:15:33.918429 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9f0ee4be50354a20baf5af85aeb4c3b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9f0ee4be50354a20baf5af85aeb4c3b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9f0ee4be50354a20baf5af85aeb4c3b2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9f0ee4be50354a20baf5af85aeb4c3b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}] Jun 07 22:15:33.918429 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1012893920 Jun 07 22:15:33.918429 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant-Id: 9f0ee4be50354a20baf5af85aeb4c3b2 Jun 07 22:15:33.918429 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1012893920 Jun 07 22:15:33.918429 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User: tempest-AttachVolumeShelveTestJSON-1012893920-project Jun 07 22:15:33.918429 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Domain-Id: default Jun 07 22:15:33.918429 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Domain-Name: Default Jun 07 22:15:33.918429 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Id: de021dc74a4446d8b6a63883fd56a7c4 Jun 07 22:15:33.918429 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1012893920-project Jun 07 22:15:33.918429 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: method: > Jun 07 22:15:33.918429 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: exception: Instance cddfb0ad-63f6-4b0d-bf12-d388bfb0714c could not be found. Jun 07 22:15:33.918429 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: action_args: {'id': 'cddfb0ad-63f6-4b0d-bf12-d388bfb0714c'} Jun 07 22:15:33.919287 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 22:15:33.919287 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:15:33.919287 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 22:15:33.919287 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 22:15:33.919287 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 22:15:33.919287 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 22:15:33.919287 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 22:15:33.919287 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 22:15:33.919287 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 22:15:33.919287 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 22:15:33.919287 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cddfb0ad-63f6-4b0d-bf12-d388bfb0714c could not be found. Jun 07 22:15:33.919287 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:15:33.919287 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:15:33.919287 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:15:33.919287 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:15:33.919287 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:15:33.919287 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:15:33.919287 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 22:15:33.919287 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 22:15:33.919287 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 22:15:33.920708 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 22:15:33.920708 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 22:15:33.920708 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 22:15:33.920708 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 22:15:33.920708 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 22:15:33.920708 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 22:15:33.920708 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 22:15:33.920708 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cddfb0ad-63f6-4b0d-bf12-d388bfb0714c could not be found. Jun 07 22:15:33.920708 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:15:33.920708 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:15:33.920708 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:15:33.920708 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:15:33.920708 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:15:33.920708 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:15:33.920708 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 22:15:33.920708 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 22:15:33.920708 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cddfb0ad-63f6-4b0d-bf12-d388bfb0714c could not be found. Jun 07 22:15:33.920708 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:15:33.921955 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-0e88f777-ddd8-4238-a0ea-9be0bc4971c3 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Returning 404 to user: Instance cddfb0ad-63f6-4b0d-bf12-d388bfb0714c could not be found. {{(pid=117971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 22:15:33.921955 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-0e88f777-ddd8-4238-a0ea-9be0bc4971c3 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c" status: 404 len: 111 microversion: 2.20 time: 0.028852 Jun 07 22:15:33.921955 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 685/1348] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:15:33 2022] GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 07 22:15:33.927530 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-7931f45e-7233-4370-badb-a2d62fde0cb1 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '.version_select at 0x7f92f0f8e4c0>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:33.946634 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-7931f45e-7233-4370-badb-a2d62fde0cb1 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-698275809" status: 204 len: 0 microversion: 2.20 time: 0.023612 Jun 07 22:15:33.947423 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 664/1349] 10.222.0.13 () {60 vars in 1258 bytes} [Tue Jun 7 22:15:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-698275809 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 07 22:15:34.735091 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-5c0abd02-e5dc-4472-84b2-4b66786b9069 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:34.735721 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-5c0abd02-e5dc-4472-84b2-4b66786b9069 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] [instance: 4d8ab38f-db6d-4560-962e-c1e55c509ce1] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:15:34.742470 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-5c0abd02-e5dc-4472-84b2-4b66786b9069 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:34.742913 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-5c0abd02-e5dc-4472-84b2-4b66786b9069 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:34.743689 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-5c0abd02-e5dc-4472-84b2-4b66786b9069 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:34.744121 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-5c0abd02-e5dc-4472-84b2-4b66786b9069 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:34.877246 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-5c0abd02-e5dc-4472-84b2-4b66786b9069 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e8c46b1820a4ce5ac853ab1cc88fc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98914183afee4e58ad7a425cb019e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:15:34.885069 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-5c0abd02-e5dc-4472-84b2-4b66786b9069 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] 10.222.0.13 "GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1" status: 200 len: 1569 microversion: 2.1 time: 0.153758 Jun 07 22:15:34.885634 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 686/1350] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:15:34 2022] GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:15:35.733722 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-89fa9aa9-a066-4ceb-b2a8-41889085e98d tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:35.734219 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-89fa9aa9-a066-4ceb-b2a8-41889085e98d tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: cddfb0ad-63f6-4b0d-bf12-d388bfb0714c] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:15:35.740553 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-89fa9aa9-a066-4ceb-b2a8-41889085e98d tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:35.740993 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-89fa9aa9-a066-4ceb-b2a8-41889085e98d tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:35.741730 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-89fa9aa9-a066-4ceb-b2a8-41889085e98d tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:35.742158 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-89fa9aa9-a066-4ceb-b2a8-41889085e98d tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:35.755969 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.wsgi [None req-89fa9aa9-a066-4ceb-b2a8-41889085e98d tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] HTTP exception thrown: Instance cddfb0ad-63f6-4b0d-bf12-d388bfb0714c could not be found. Jun 07 22:15:35.757612 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-89fa9aa9-a066-4ceb-b2a8-41889085e98d tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Request method failure captured: Jun 07 22:15:35.757612 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: request: DELETE /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c HTTP/1.1 Jun 07 22:15:35.757612 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Accept: application/json Jun 07 22:15:35.757612 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Accept-Encoding: identity Jun 07 22:15:35.757612 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Connection: close Jun 07 22:15:35.757612 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Content-Length: 0 Jun 07 22:15:35.757612 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Content-Type: application/json Jun 07 22:15:35.757612 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Host: 10.222.0.13 Jun 07 22:15:35.757612 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Openstack-System-Scope: None Jun 07 22:15:35.757612 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: User-Agent: python-urllib3/1.26.9 Jun 07 22:15:35.757612 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Auth-Token: gAAAAABin8uPjY2n2U1UfD4BAC2BIPUnwdSjtmQlXMcGhyJKVuNwqCxKLwue5dUbR_nnn0f1dXWMonXAfPVmaYaFFK195PB3zvnPxXy5QcfNuc_jj0zriGmy8yorTG8wSIV834eMYCFSAP3BcLoYzwSynfDxfY2lVxuTIQljKk3LHvbzv2JrNjM Jun 07 22:15:35.757612 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Domain-Id: None Jun 07 22:15:35.757612 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Domain-Name: None Jun 07 22:15:35.757612 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Identity-Status: Confirmed Jun 07 22:15:35.757612 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Is-Admin-Project: True Jun 07 22:15:35.757612 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Openstack-Nova-Api-Version: 2.20 Jun 07 22:15:35.757612 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Domain-Id: default Jun 07 22:15:35.757612 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Domain-Name: Default Jun 07 22:15:35.757612 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Id: 9f0ee4be50354a20baf5af85aeb4c3b2 Jun 07 22:15:35.757612 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1012893920 Jun 07 22:15:35.757612 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Role: member,reader Jun 07 22:15:35.757612 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Roles: member,reader Jun 07 22:15:35.759519 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9f0ee4be50354a20baf5af85aeb4c3b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9f0ee4be50354a20baf5af85aeb4c3b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9f0ee4be50354a20baf5af85aeb4c3b2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9f0ee4be50354a20baf5af85aeb4c3b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}] Jun 07 22:15:35.759519 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1012893920 Jun 07 22:15:35.759519 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Tenant-Id: 9f0ee4be50354a20baf5af85aeb4c3b2 Jun 07 22:15:35.759519 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1012893920 Jun 07 22:15:35.759519 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User: tempest-AttachVolumeShelveTestJSON-1012893920-project Jun 07 22:15:35.759519 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Domain-Id: default Jun 07 22:15:35.759519 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Domain-Name: Default Jun 07 22:15:35.759519 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Id: de021dc74a4446d8b6a63883fd56a7c4 Jun 07 22:15:35.759519 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1012893920-project Jun 07 22:15:35.759519 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: method: > Jun 07 22:15:35.759519 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: exception: Instance cddfb0ad-63f6-4b0d-bf12-d388bfb0714c could not be found. Jun 07 22:15:35.759519 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: action_args: {'id': 'cddfb0ad-63f6-4b0d-bf12-d388bfb0714c'} Jun 07 22:15:35.760615 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 22:15:35.760615 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:15:35.760615 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 22:15:35.760615 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 22:15:35.760615 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 22:15:35.760615 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 22:15:35.760615 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 22:15:35.760615 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 22:15:35.760615 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 22:15:35.760615 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 22:15:35.760615 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cddfb0ad-63f6-4b0d-bf12-d388bfb0714c could not be found. Jun 07 22:15:35.760615 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:15:35.760615 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:15:35.760615 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:15:35.760615 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:15:35.760615 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:15:35.760615 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:15:35.760615 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 22:15:35.760615 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 22:15:35.760615 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 22:15:35.762250 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 22:15:35.762250 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 22:15:35.762250 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 22:15:35.762250 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 22:15:35.762250 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 22:15:35.762250 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 22:15:35.762250 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 22:15:35.762250 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 22:15:35.762250 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 22:15:35.762250 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cddfb0ad-63f6-4b0d-bf12-d388bfb0714c could not be found. Jun 07 22:15:35.762250 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:15:35.762250 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:15:35.762250 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:15:35.762250 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:15:35.762250 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:15:35.762250 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:15:35.762250 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 22:15:35.762250 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 22:15:35.762250 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cddfb0ad-63f6-4b0d-bf12-d388bfb0714c could not be found. Jun 07 22:15:35.762250 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:15:35.764457 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-89fa9aa9-a066-4ceb-b2a8-41889085e98d tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Returning 404 to user: Instance cddfb0ad-63f6-4b0d-bf12-d388bfb0714c could not be found. {{(pid=117970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 22:15:35.764457 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-89fa9aa9-a066-4ceb-b2a8-41889085e98d tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "DELETE /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c" status: 404 len: 111 microversion: 2.20 time: 0.029078 Jun 07 22:15:35.764457 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 665/1351] 10.222.0.13 () {60 vars in 1279 bytes} [Tue Jun 7 22:15:35 2022] DELETE /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 07 22:15:35.771004 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-85aa4f83-061f-47f6-a7ed-153a13f4d195 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:35.771682 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-85aa4f83-061f-47f6-a7ed-153a13f4d195 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: cddfb0ad-63f6-4b0d-bf12-d388bfb0714c] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:15:35.778011 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-85aa4f83-061f-47f6-a7ed-153a13f4d195 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:35.778457 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-85aa4f83-061f-47f6-a7ed-153a13f4d195 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:35.779217 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-85aa4f83-061f-47f6-a7ed-153a13f4d195 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:35.779755 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-85aa4f83-061f-47f6-a7ed-153a13f4d195 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:35.792769 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.wsgi [None req-85aa4f83-061f-47f6-a7ed-153a13f4d195 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] HTTP exception thrown: Instance cddfb0ad-63f6-4b0d-bf12-d388bfb0714c could not be found. Jun 07 22:15:35.794288 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-85aa4f83-061f-47f6-a7ed-153a13f4d195 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Request method failure captured: Jun 07 22:15:35.794288 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: request: GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c HTTP/1.1 Jun 07 22:15:35.794288 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Accept: application/json Jun 07 22:15:35.794288 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Accept-Encoding: identity Jun 07 22:15:35.794288 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Connection: close Jun 07 22:15:35.794288 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Content-Length: 0 Jun 07 22:15:35.794288 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Content-Type: application/json Jun 07 22:15:35.794288 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Host: 10.222.0.13 Jun 07 22:15:35.794288 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Openstack-System-Scope: None Jun 07 22:15:35.794288 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: User-Agent: python-urllib3/1.26.9 Jun 07 22:15:35.794288 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Auth-Token: gAAAAABin8uPjY2n2U1UfD4BAC2BIPUnwdSjtmQlXMcGhyJKVuNwqCxKLwue5dUbR_nnn0f1dXWMonXAfPVmaYaFFK195PB3zvnPxXy5QcfNuc_jj0zriGmy8yorTG8wSIV834eMYCFSAP3BcLoYzwSynfDxfY2lVxuTIQljKk3LHvbzv2JrNjM Jun 07 22:15:35.794288 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Domain-Id: None Jun 07 22:15:35.794288 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Domain-Name: None Jun 07 22:15:35.794288 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Identity-Status: Confirmed Jun 07 22:15:35.794288 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Is-Admin-Project: True Jun 07 22:15:35.794288 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Openstack-Nova-Api-Version: 2.20 Jun 07 22:15:35.794288 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Domain-Id: default Jun 07 22:15:35.794288 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Domain-Name: Default Jun 07 22:15:35.794288 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Id: 9f0ee4be50354a20baf5af85aeb4c3b2 Jun 07 22:15:35.794288 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1012893920 Jun 07 22:15:35.794288 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Role: member,reader Jun 07 22:15:35.794288 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Roles: member,reader Jun 07 22:15:35.796088 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9f0ee4be50354a20baf5af85aeb4c3b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9f0ee4be50354a20baf5af85aeb4c3b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9f0ee4be50354a20baf5af85aeb4c3b2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9f0ee4be50354a20baf5af85aeb4c3b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}] Jun 07 22:15:35.796088 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1012893920 Jun 07 22:15:35.796088 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant-Id: 9f0ee4be50354a20baf5af85aeb4c3b2 Jun 07 22:15:35.796088 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1012893920 Jun 07 22:15:35.796088 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User: tempest-AttachVolumeShelveTestJSON-1012893920-project Jun 07 22:15:35.796088 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Domain-Id: default Jun 07 22:15:35.796088 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Domain-Name: Default Jun 07 22:15:35.796088 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Id: de021dc74a4446d8b6a63883fd56a7c4 Jun 07 22:15:35.796088 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1012893920-project Jun 07 22:15:35.796088 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: method: > Jun 07 22:15:35.796088 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: exception: Instance cddfb0ad-63f6-4b0d-bf12-d388bfb0714c could not be found. Jun 07 22:15:35.796088 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: action_args: {'id': 'cddfb0ad-63f6-4b0d-bf12-d388bfb0714c'} Jun 07 22:15:35.796970 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 22:15:35.796970 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:15:35.796970 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 22:15:35.796970 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 22:15:35.796970 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 22:15:35.796970 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 22:15:35.796970 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 22:15:35.796970 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 22:15:35.796970 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 22:15:35.796970 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 22:15:35.796970 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cddfb0ad-63f6-4b0d-bf12-d388bfb0714c could not be found. Jun 07 22:15:35.796970 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:15:35.796970 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:15:35.796970 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:15:35.796970 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:15:35.796970 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:15:35.796970 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:15:35.796970 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 22:15:35.796970 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 22:15:35.796970 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 22:15:35.798719 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 22:15:35.798719 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 22:15:35.798719 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 22:15:35.798719 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 22:15:35.798719 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 22:15:35.798719 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 22:15:35.798719 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 22:15:35.798719 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cddfb0ad-63f6-4b0d-bf12-d388bfb0714c could not be found. Jun 07 22:15:35.798719 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:15:35.798719 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:15:35.798719 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:15:35.798719 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:15:35.798719 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:15:35.798719 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:15:35.798719 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 22:15:35.798719 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 22:15:35.798719 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cddfb0ad-63f6-4b0d-bf12-d388bfb0714c could not be found. Jun 07 22:15:35.798719 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:15:35.800317 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-85aa4f83-061f-47f6-a7ed-153a13f4d195 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Returning 404 to user: Instance cddfb0ad-63f6-4b0d-bf12-d388bfb0714c could not be found. {{(pid=117971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 22:15:35.800317 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-85aa4f83-061f-47f6-a7ed-153a13f4d195 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c" status: 404 len: 111 microversion: 2.20 time: 0.029274 Jun 07 22:15:35.800317 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 687/1352] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:15:35 2022] GET /compute/v2.1/servers/cddfb0ad-63f6-4b0d-bf12-d388bfb0714c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 07 22:15:35.902028 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-3f90866e-6e21-44d9-8469-738eb1e01629 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:35.902632 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-3f90866e-6e21-44d9-8469-738eb1e01629 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] [instance: 4d8ab38f-db6d-4560-962e-c1e55c509ce1] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:15:35.908505 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-3f90866e-6e21-44d9-8469-738eb1e01629 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:35.908949 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-3f90866e-6e21-44d9-8469-738eb1e01629 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:35.909696 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-3f90866e-6e21-44d9-8469-738eb1e01629 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:35.910126 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-3f90866e-6e21-44d9-8469-738eb1e01629 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:36.036690 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-3f90866e-6e21-44d9-8469-738eb1e01629 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e8c46b1820a4ce5ac853ab1cc88fc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98914183afee4e58ad7a425cb019e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:15:36.044133 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-3f90866e-6e21-44d9-8469-738eb1e01629 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] 10.222.0.13 "GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1" status: 200 len: 1569 microversion: 2.1 time: 0.145916 Jun 07 22:15:36.044689 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 666/1353] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:15:35 2022] GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1 => generated 1569 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:15:36.936697 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-932ead22-b43f-4f21-93d7-8a85a15c8c07 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:36.937202 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-932ead22-b43f-4f21-93d7-8a85a15c8c07 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:15:36.943454 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-932ead22-b43f-4f21-93d7-8a85a15c8c07 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:36.943906 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-932ead22-b43f-4f21-93d7-8a85a15c8c07 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:36.944653 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-932ead22-b43f-4f21-93d7-8a85a15c8c07 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:36.945082 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-932ead22-b43f-4f21-93d7-8a85a15c8c07 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:36.959009 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.wsgi [None req-932ead22-b43f-4f21-93d7-8a85a15c8c07 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] HTTP exception thrown: Instance 07abb105-095a-47ad-8761-b5075254ac95 could not be found. Jun 07 22:15:36.960570 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-932ead22-b43f-4f21-93d7-8a85a15c8c07 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Request method failure captured: Jun 07 22:15:36.960570 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: request: DELETE /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 HTTP/1.1 Jun 07 22:15:36.960570 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Accept: application/json Jun 07 22:15:36.960570 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Accept-Encoding: identity Jun 07 22:15:36.960570 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Connection: close Jun 07 22:15:36.960570 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Content-Length: 0 Jun 07 22:15:36.960570 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Content-Type: application/json Jun 07 22:15:36.960570 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Host: 10.222.0.13 Jun 07 22:15:36.960570 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Openstack-System-Scope: None Jun 07 22:15:36.960570 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: User-Agent: python-urllib3/1.26.9 Jun 07 22:15:36.960570 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Auth-Token: gAAAAABin8uPjY2n2U1UfD4BAC2BIPUnwdSjtmQlXMcGhyJKVuNwqCxKLwue5dUbR_nnn0f1dXWMonXAfPVmaYaFFK195PB3zvnPxXy5QcfNuc_jj0zriGmy8yorTG8wSIV834eMYCFSAP3BcLoYzwSynfDxfY2lVxuTIQljKk3LHvbzv2JrNjM Jun 07 22:15:36.960570 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Domain-Id: None Jun 07 22:15:36.960570 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Domain-Name: None Jun 07 22:15:36.960570 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Identity-Status: Confirmed Jun 07 22:15:36.960570 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Is-Admin-Project: True Jun 07 22:15:36.960570 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Openstack-Nova-Api-Version: 2.20 Jun 07 22:15:36.960570 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Domain-Id: default Jun 07 22:15:36.960570 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Domain-Name: Default Jun 07 22:15:36.960570 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Id: 9f0ee4be50354a20baf5af85aeb4c3b2 Jun 07 22:15:36.960570 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1012893920 Jun 07 22:15:36.960570 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Role: member,reader Jun 07 22:15:36.960570 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Roles: member,reader Jun 07 22:15:36.962267 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9f0ee4be50354a20baf5af85aeb4c3b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9f0ee4be50354a20baf5af85aeb4c3b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9f0ee4be50354a20baf5af85aeb4c3b2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9f0ee4be50354a20baf5af85aeb4c3b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}] Jun 07 22:15:36.962267 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1012893920 Jun 07 22:15:36.962267 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant-Id: 9f0ee4be50354a20baf5af85aeb4c3b2 Jun 07 22:15:36.962267 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1012893920 Jun 07 22:15:36.962267 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User: tempest-AttachVolumeShelveTestJSON-1012893920-project Jun 07 22:15:36.962267 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Domain-Id: default Jun 07 22:15:36.962267 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Domain-Name: Default Jun 07 22:15:36.962267 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Id: de021dc74a4446d8b6a63883fd56a7c4 Jun 07 22:15:36.962267 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1012893920-project Jun 07 22:15:36.962267 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: method: > Jun 07 22:15:36.962267 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: exception: Instance 07abb105-095a-47ad-8761-b5075254ac95 could not be found. Jun 07 22:15:36.962267 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: action_args: {'id': '07abb105-095a-47ad-8761-b5075254ac95'} Jun 07 22:15:36.963300 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 22:15:36.963300 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:15:36.963300 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 22:15:36.963300 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 22:15:36.963300 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 22:15:36.963300 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 22:15:36.963300 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 22:15:36.963300 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 22:15:36.963300 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 22:15:36.963300 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 22:15:36.963300 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07abb105-095a-47ad-8761-b5075254ac95 could not be found. Jun 07 22:15:36.963300 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:15:36.963300 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:15:36.963300 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:15:36.963300 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:15:36.963300 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:15:36.963300 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:15:36.963300 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 22:15:36.963300 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 22:15:36.963300 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 22:15:36.964922 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 22:15:36.964922 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 22:15:36.964922 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 22:15:36.964922 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 22:15:36.964922 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 22:15:36.964922 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 22:15:36.964922 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 22:15:36.964922 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 22:15:36.964922 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 22:15:36.964922 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07abb105-095a-47ad-8761-b5075254ac95 could not be found. Jun 07 22:15:36.964922 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:15:36.964922 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:15:36.964922 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:15:36.964922 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:15:36.964922 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:15:36.964922 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:15:36.964922 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 22:15:36.964922 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 22:15:36.964922 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07abb105-095a-47ad-8761-b5075254ac95 could not be found. Jun 07 22:15:36.964922 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:15:36.966416 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-932ead22-b43f-4f21-93d7-8a85a15c8c07 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Returning 404 to user: Instance 07abb105-095a-47ad-8761-b5075254ac95 could not be found. {{(pid=117971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 22:15:36.966416 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-932ead22-b43f-4f21-93d7-8a85a15c8c07 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "DELETE /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 404 len: 111 microversion: 2.20 time: 0.029120 Jun 07 22:15:36.966416 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 688/1354] 10.222.0.13 () {60 vars in 1279 bytes} [Tue Jun 7 22:15:36 2022] DELETE /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 07 22:15:36.970198 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-c59c93de-f8ac-4112-859f-98b1edae4572 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:36.970801 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-c59c93de-f8ac-4112-859f-98b1edae4572 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] [instance: 07abb105-095a-47ad-8761-b5075254ac95] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:15:36.978153 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c59c93de-f8ac-4112-859f-98b1edae4572 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:36.978942 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c59c93de-f8ac-4112-859f-98b1edae4572 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:36.979788 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c59c93de-f8ac-4112-859f-98b1edae4572 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:36.980224 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c59c93de-f8ac-4112-859f-98b1edae4572 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:36.993580 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.wsgi [None req-c59c93de-f8ac-4112-859f-98b1edae4572 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] HTTP exception thrown: Instance 07abb105-095a-47ad-8761-b5075254ac95 could not be found. Jun 07 22:15:36.995080 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-c59c93de-f8ac-4112-859f-98b1edae4572 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Request method failure captured: Jun 07 22:15:36.995080 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: request: GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 HTTP/1.1 Jun 07 22:15:36.995080 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Accept: application/json Jun 07 22:15:36.995080 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Accept-Encoding: identity Jun 07 22:15:36.995080 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Connection: close Jun 07 22:15:36.995080 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Content-Length: 0 Jun 07 22:15:36.995080 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Content-Type: application/json Jun 07 22:15:36.995080 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Host: 10.222.0.13 Jun 07 22:15:36.995080 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Openstack-System-Scope: None Jun 07 22:15:36.995080 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: User-Agent: python-urllib3/1.26.9 Jun 07 22:15:36.995080 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Auth-Token: gAAAAABin8uPjY2n2U1UfD4BAC2BIPUnwdSjtmQlXMcGhyJKVuNwqCxKLwue5dUbR_nnn0f1dXWMonXAfPVmaYaFFK195PB3zvnPxXy5QcfNuc_jj0zriGmy8yorTG8wSIV834eMYCFSAP3BcLoYzwSynfDxfY2lVxuTIQljKk3LHvbzv2JrNjM Jun 07 22:15:36.995080 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Domain-Id: None Jun 07 22:15:36.995080 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Domain-Name: None Jun 07 22:15:36.995080 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Identity-Status: Confirmed Jun 07 22:15:36.995080 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Is-Admin-Project: True Jun 07 22:15:36.995080 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Openstack-Nova-Api-Version: 2.20 Jun 07 22:15:36.995080 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Domain-Id: default Jun 07 22:15:36.995080 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Domain-Name: Default Jun 07 22:15:36.995080 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Id: 9f0ee4be50354a20baf5af85aeb4c3b2 Jun 07 22:15:36.995080 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1012893920 Jun 07 22:15:36.995080 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Role: member,reader Jun 07 22:15:36.995080 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Roles: member,reader Jun 07 22:15:36.996812 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9f0ee4be50354a20baf5af85aeb4c3b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9f0ee4be50354a20baf5af85aeb4c3b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9f0ee4be50354a20baf5af85aeb4c3b2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9f0ee4be50354a20baf5af85aeb4c3b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}] Jun 07 22:15:36.996812 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1012893920 Jun 07 22:15:36.996812 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Tenant-Id: 9f0ee4be50354a20baf5af85aeb4c3b2 Jun 07 22:15:36.996812 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1012893920 Jun 07 22:15:36.996812 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User: tempest-AttachVolumeShelveTestJSON-1012893920-project Jun 07 22:15:36.996812 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Domain-Id: default Jun 07 22:15:36.996812 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Domain-Name: Default Jun 07 22:15:36.996812 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Id: de021dc74a4446d8b6a63883fd56a7c4 Jun 07 22:15:36.996812 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1012893920-project Jun 07 22:15:36.996812 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: method: > Jun 07 22:15:36.996812 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: exception: Instance 07abb105-095a-47ad-8761-b5075254ac95 could not be found. Jun 07 22:15:36.996812 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: action_args: {'id': '07abb105-095a-47ad-8761-b5075254ac95'} Jun 07 22:15:36.997909 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 22:15:36.997909 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:15:36.997909 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 22:15:36.997909 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 22:15:36.997909 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 22:15:36.997909 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 22:15:36.997909 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 22:15:36.997909 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 22:15:36.997909 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 22:15:36.997909 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 22:15:36.997909 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07abb105-095a-47ad-8761-b5075254ac95 could not be found. Jun 07 22:15:36.997909 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:15:36.997909 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:15:36.997909 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:15:36.997909 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:15:36.997909 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:15:36.997909 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:15:36.997909 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 22:15:36.997909 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 22:15:36.997909 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 22:15:36.999461 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 22:15:36.999461 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 22:15:36.999461 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 22:15:36.999461 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 22:15:36.999461 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 22:15:36.999461 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 22:15:36.999461 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 22:15:36.999461 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07abb105-095a-47ad-8761-b5075254ac95 could not be found. Jun 07 22:15:36.999461 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:15:36.999461 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:15:36.999461 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:15:36.999461 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:15:36.999461 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:15:36.999461 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:15:36.999461 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 22:15:36.999461 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 22:15:36.999461 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07abb105-095a-47ad-8761-b5075254ac95 could not be found. Jun 07 22:15:36.999461 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:15:37.000845 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-c59c93de-f8ac-4112-859f-98b1edae4572 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] Returning 404 to user: Instance 07abb105-095a-47ad-8761-b5075254ac95 could not be found. {{(pid=117970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 22:15:37.000845 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-c59c93de-f8ac-4112-859f-98b1edae4572 tempest-AttachVolumeShelveTestJSON-1012893920 tempest-AttachVolumeShelveTestJSON-1012893920-project] 10.222.0.13 "GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95" status: 404 len: 111 microversion: 2.20 time: 0.030018 Jun 07 22:15:37.000845 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 667/1355] 10.222.0.13 () {60 vars in 1276 bytes} [Tue Jun 7 22:15:36 2022] GET /compute/v2.1/servers/07abb105-095a-47ad-8761-b5075254ac95 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 07 22:15:37.061302 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-5d4300b9-77dd-4baf-a7eb-b93e1d5ffb63 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:37.061883 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-5d4300b9-77dd-4baf-a7eb-b93e1d5ffb63 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] [instance: 4d8ab38f-db6d-4560-962e-c1e55c509ce1] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:15:37.069222 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-5d4300b9-77dd-4baf-a7eb-b93e1d5ffb63 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:37.069662 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-5d4300b9-77dd-4baf-a7eb-b93e1d5ffb63 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:37.070407 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-5d4300b9-77dd-4baf-a7eb-b93e1d5ffb63 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:37.070833 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-5d4300b9-77dd-4baf-a7eb-b93e1d5ffb63 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:37.206100 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-5d4300b9-77dd-4baf-a7eb-b93e1d5ffb63 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e8c46b1820a4ce5ac853ab1cc88fc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98914183afee4e58ad7a425cb019e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:15:37.214697 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-5d4300b9-77dd-4baf-a7eb-b93e1d5ffb63 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] 10.222.0.13 "GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1" status: 200 len: 1569 microversion: 2.1 time: 0.157180 Jun 07 22:15:37.215270 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 689/1356] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:15:37 2022] GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:15:38.232716 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-d6172256-6550-4b83-aac8-a415494fc404 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:38.233329 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-d6172256-6550-4b83-aac8-a415494fc404 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] [instance: 4d8ab38f-db6d-4560-962e-c1e55c509ce1] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:15:38.241437 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d6172256-6550-4b83-aac8-a415494fc404 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:38.241878 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d6172256-6550-4b83-aac8-a415494fc404 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:38.242639 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d6172256-6550-4b83-aac8-a415494fc404 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:38.243064 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d6172256-6550-4b83-aac8-a415494fc404 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:38.494905 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-d6172256-6550-4b83-aac8-a415494fc404 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e8c46b1820a4ce5ac853ab1cc88fc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98914183afee4e58ad7a425cb019e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:15:38.502514 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-d6172256-6550-4b83-aac8-a415494fc404 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] 10.222.0.13 "GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1" status: 200 len: 1569 microversion: 2.1 time: 0.274001 Jun 07 22:15:38.503176 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 668/1357] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:15:38 2022] GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1 => generated 1569 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:15:39.519957 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-2ca65d14-b5c6-4d0c-89c0-b152052d074c tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:39.522015 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-2ca65d14-b5c6-4d0c-89c0-b152052d074c tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] [instance: 4d8ab38f-db6d-4560-962e-c1e55c509ce1] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:15:39.529981 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-2ca65d14-b5c6-4d0c-89c0-b152052d074c tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:39.530559 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-2ca65d14-b5c6-4d0c-89c0-b152052d074c tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:39.531492 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-2ca65d14-b5c6-4d0c-89c0-b152052d074c tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:39.532197 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-2ca65d14-b5c6-4d0c-89c0-b152052d074c tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:39.553209 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:15:39.760024 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-2ca65d14-b5c6-4d0c-89c0-b152052d074c tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e8c46b1820a4ce5ac853ab1cc88fc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98914183afee4e58ad7a425cb019e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:15:39.770162 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-2ca65d14-b5c6-4d0c-89c0-b152052d074c tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] 10.222.0.13 "GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1" status: 200 len: 1569 microversion: 2.1 time: 0.254189 Jun 07 22:15:39.778448 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 690/1358] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:15:39 2022] GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1 => generated 1569 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:15:40.788972 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-08f9ddc2-b808-492b-bf57-1a2a442fbc64 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:40.789577 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-08f9ddc2-b808-492b-bf57-1a2a442fbc64 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] [instance: 4d8ab38f-db6d-4560-962e-c1e55c509ce1] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:15:40.796019 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-08f9ddc2-b808-492b-bf57-1a2a442fbc64 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:40.796460 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-08f9ddc2-b808-492b-bf57-1a2a442fbc64 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:40.797199 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-08f9ddc2-b808-492b-bf57-1a2a442fbc64 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:40.797625 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-08f9ddc2-b808-492b-bf57-1a2a442fbc64 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:40.817266 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:15:40.996057 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-08f9ddc2-b808-492b-bf57-1a2a442fbc64 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e8c46b1820a4ce5ac853ab1cc88fc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98914183afee4e58ad7a425cb019e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:15:41.003680 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-08f9ddc2-b808-492b-bf57-1a2a442fbc64 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] 10.222.0.13 "GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1" status: 200 len: 1569 microversion: 2.1 time: 0.219234 Jun 07 22:15:41.005021 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 669/1359] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:15:40 2022] GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1 => generated 1569 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:15:41.871689 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-0ce82acc-1091-4aaf-915b-d5f62eee8159 tempest-VolumesSnapshotsTestJSON-2141719477 tempest-VolumesSnapshotsTestJSON-2141719477-project] Action: 'create', calling method: .version_select at 0x7f92f6766c10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-523409009"}} {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:15:42.023147 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-28642b27-b73d-4a58-aa69-5c9e8e727203 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:42.024528 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-28642b27-b73d-4a58-aa69-5c9e8e727203 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] [instance: 4d8ab38f-db6d-4560-962e-c1e55c509ce1] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:15:42.031407 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-28642b27-b73d-4a58-aa69-5c9e8e727203 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:42.032314 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-28642b27-b73d-4a58-aa69-5c9e8e727203 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:42.033427 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-28642b27-b73d-4a58-aa69-5c9e8e727203 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:42.034012 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-28642b27-b73d-4a58-aa69-5c9e8e727203 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:42.192686 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-0ce82acc-1091-4aaf-915b-d5f62eee8159 tempest-VolumesSnapshotsTestJSON-2141719477 tempest-VolumesSnapshotsTestJSON-2141719477-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.440331 Jun 07 22:15:42.193370 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 691/1360] 10.222.0.13 () {60 vars in 1154 bytes} [Tue Jun 7 22:15:41 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 442 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jun 07 22:15:42.204011 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-bf2734d9-8a42-4692-87a6-cb3c278ef51a tempest-VolumesSnapshotsTestJSON-2141719477 tempest-VolumesSnapshotsTestJSON-2141719477-project] Calling method '.version_select at 0x7f92f6719790>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:42.248780 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-28642b27-b73d-4a58-aa69-5c9e8e727203 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e8c46b1820a4ce5ac853ab1cc88fc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98914183afee4e58ad7a425cb019e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:15:42.257477 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-28642b27-b73d-4a58-aa69-5c9e8e727203 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] 10.222.0.13 "GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1" status: 200 len: 1569 microversion: 2.1 time: 0.239312 Jun 07 22:15:42.258128 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 670/1361] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:15:42 2022] GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1 => generated 1569 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:15:42.258334 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-bf2734d9-8a42-4692-87a6-cb3c278ef51a tempest-VolumesSnapshotsTestJSON-2141719477 tempest-VolumesSnapshotsTestJSON-2141719477-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/f224d195-7082-4829-a9bd-ce91548cccc6" status: 200 len: 344 microversion: 2.1 time: 0.057972 Jun 07 22:15:42.259047 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 692/1362] 10.222.0.13 () {58 vars in 1244 bytes} [Tue Jun 7 22:15:42 2022] GET /compute/v2.1/os-volumes/f224d195-7082-4829-a9bd-ce91548cccc6 => generated 344 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 22:15:42.726699 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-f099001a-b877-41d6-8189-30d8d0dd4564 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:42.727202 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-f099001a-b877-41d6-8189-30d8d0dd4564 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: 396f0b5c-2d4c-486e-9ab6-b781fc612a4a] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:15:42.735930 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [req-bea7239d-62b3-4c91-9cfa-2af10c426a43 req-3be4b0b5-4900-40b4-8acb-a46288a64c7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "396f0b5c-2d4c-486e-9ab6-b781fc612a4a", "tag": "5b7c7edd-c543-41ae-bf73-9c85442dfb14"}]} {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:15:42.745864 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f099001a-b877-41d6-8189-30d8d0dd4564 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:42.746324 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f099001a-b877-41d6-8189-30d8d0dd4564 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:42.747095 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f099001a-b877-41d6-8189-30d8d0dd4564 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:42.747565 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f099001a-b877-41d6-8189-30d8d0dd4564 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:42.756546 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-bea7239d-62b3-4c91-9cfa-2af10c426a43 req-3be4b0b5-4900-40b4-8acb-a46288a64c7d service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:42.757295 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-bea7239d-62b3-4c91-9cfa-2af10c426a43 req-3be4b0b5-4900-40b4-8acb-a46288a64c7d service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:42.777564 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.compute.server_external_events [req-bea7239d-62b3-4c91-9cfa-2af10c426a43 req-3be4b0b5-4900-40b4-8acb-a46288a64c7d service nova] Creating event network-changed:5b7c7edd-c543-41ae-bf73-9c85442dfb14 for instance 396f0b5c-2d4c-486e-9ab6-b781fc612a4a on hv-cinder-83552 Jun 07 22:15:42.785426 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [req-bea7239d-62b3-4c91-9cfa-2af10c426a43 req-3be4b0b5-4900-40b4-8acb-a46288a64c7d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052623 Jun 07 22:15:42.786932 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 693/1363] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:15:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:15:42.794872 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-f099001a-b877-41d6-8189-30d8d0dd4564 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: 396f0b5c-2d4c-486e-9ab6-b781fc612a4a] Going to try to terminate instance {{(pid=117970) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 22:15:42.889464 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-f099001a-b877-41d6-8189-30d8d0dd4564 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "DELETE /compute/v2.1/servers/396f0b5c-2d4c-486e-9ab6-b781fc612a4a" status: 204 len: 0 microversion: 2.1 time: 0.166266 Jun 07 22:15:42.890480 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 671/1364] 10.222.0.13 () {58 vars in 1238 bytes} [Tue Jun 7 22:15:42 2022] DELETE /compute/v2.1/servers/396f0b5c-2d4c-486e-9ab6-b781fc612a4a => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 22:15:42.901134 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-bfd87984-4d11-4825-9606-56b7b1b52215 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:42.901837 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-bfd87984-4d11-4825-9606-56b7b1b52215 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: 396f0b5c-2d4c-486e-9ab6-b781fc612a4a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:15:42.908708 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-bfd87984-4d11-4825-9606-56b7b1b52215 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:42.909146 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-bfd87984-4d11-4825-9606-56b7b1b52215 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:42.910287 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-bfd87984-4d11-4825-9606-56b7b1b52215 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:42.910994 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-bfd87984-4d11-4825-9606-56b7b1b52215 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:43.051188 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-bfd87984-4d11-4825-9606-56b7b1b52215 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:15:43.058842 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-bfd87984-4d11-4825-9606-56b7b1b52215 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/396f0b5c-2d4c-486e-9ab6-b781fc612a4a" status: 200 len: 1580 microversion: 2.1 time: 0.163692 Jun 07 22:15:43.059433 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 694/1365] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:15:42 2022] GET /compute/v2.1/servers/396f0b5c-2d4c-486e-9ab6-b781fc612a4a => generated 1580 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:15:43.275824 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-6444ed1e-7607-4ec0-bd90-86694a62051e tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:43.276749 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-6444ed1e-7607-4ec0-bd90-86694a62051e tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] [instance: 4d8ab38f-db6d-4560-962e-c1e55c509ce1] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:15:43.279213 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-61b1392e-6aee-4d62-8086-ad7090036a7b tempest-VolumesSnapshotsTestJSON-2141719477 tempest-VolumesSnapshotsTestJSON-2141719477-project] Calling method '.version_select at 0x7f92f66baf70>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:43.295098 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6444ed1e-7607-4ec0-bd90-86694a62051e tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:43.295620 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6444ed1e-7607-4ec0-bd90-86694a62051e tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:43.296401 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6444ed1e-7607-4ec0-bd90-86694a62051e tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:43.296870 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-6444ed1e-7607-4ec0-bd90-86694a62051e tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:43.328492 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-61b1392e-6aee-4d62-8086-ad7090036a7b tempest-VolumesSnapshotsTestJSON-2141719477 tempest-VolumesSnapshotsTestJSON-2141719477-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/f224d195-7082-4829-a9bd-ce91548cccc6" status: 200 len: 345 microversion: 2.1 time: 0.052931 Jun 07 22:15:43.335786 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 695/1366] 10.222.0.13 () {58 vars in 1244 bytes} [Tue Jun 7 22:15:43 2022] GET /compute/v2.1/os-volumes/f224d195-7082-4829-a9bd-ce91548cccc6 => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 22:15:43.340715 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-20baeb4b-b860-4e63-b69d-b31083e5a557 tempest-VolumesSnapshotsTestJSON-2141719477 tempest-VolumesSnapshotsTestJSON-2141719477-project] Action: 'create', calling method: .version_select at 0x7f92f6752940>, body: {"snapshot": {"volume_id": "f224d195-7082-4829-a9bd-ce91548cccc6", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-140334824"}} {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:15:43.442519 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-6444ed1e-7607-4ec0-bd90-86694a62051e tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e8c46b1820a4ce5ac853ab1cc88fc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98914183afee4e58ad7a425cb019e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:15:43.453394 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-6444ed1e-7607-4ec0-bd90-86694a62051e tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] 10.222.0.13 "GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1" status: 200 len: 1569 microversion: 2.1 time: 0.182255 Jun 07 22:15:43.464211 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 672/1367] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:15:43 2022] GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1 => generated 1569 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:15:43.503744 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-20baeb4b-b860-4e63-b69d-b31083e5a557 tempest-VolumesSnapshotsTestJSON-2141719477 tempest-VolumesSnapshotsTestJSON-2141719477-project] 10.222.0.13 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.166598 Jun 07 22:15:43.504378 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 696/1368] 10.222.0.13 () {60 vars in 1161 bytes} [Tue Jun 7 22:15:43 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:15:43.514823 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-48d88c62-e0a3-4511-ae35-02724da961d0 tempest-VolumesSnapshotsTestJSON-2141719477 tempest-VolumesSnapshotsTestJSON-2141719477-project] Calling method '.version_select at 0x7f92f0f6c040>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:43.547185 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-48d88c62-e0a3-4511-ae35-02724da961d0 tempest-VolumesSnapshotsTestJSON-2141719477 tempest-VolumesSnapshotsTestJSON-2141719477-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/35f8f2be-668b-469d-af1d-6c30a353b29b" status: 200 len: 286 microversion: 2.1 time: 0.036526 Jun 07 22:15:43.547809 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 673/1369] 10.222.0.13 () {58 vars in 1250 bytes} [Tue Jun 7 22:15:43 2022] GET /compute/v2.1/os-snapshots/35f8f2be-668b-469d-af1d-6c30a353b29b => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 22:15:43.558342 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-d1c30d0a-51ee-4e4f-b627-c5dba21cb255 tempest-VolumesSnapshotsTestJSON-2141719477 tempest-VolumesSnapshotsTestJSON-2141719477-project] Calling method '.version_select at 0x7f92f6712310>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:43.591176 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-d1c30d0a-51ee-4e4f-b627-c5dba21cb255 tempest-VolumesSnapshotsTestJSON-2141719477 tempest-VolumesSnapshotsTestJSON-2141719477-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.036782 Jun 07 22:15:43.592111 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 697/1370] 10.222.0.13 () {58 vars in 1139 bytes} [Tue Jun 7 22:15:43 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:15:43.602566 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-e3fc643f-a6ef-401a-995e-145deb55b25c tempest-VolumesSnapshotsTestJSON-2141719477 tempest-VolumesSnapshotsTestJSON-2141719477-project] Calling method '.version_select at 0x7f92f0f6cb80>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:43.632849 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-e3fc643f-a6ef-401a-995e-145deb55b25c tempest-VolumesSnapshotsTestJSON-2141719477 tempest-VolumesSnapshotsTestJSON-2141719477-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/35f8f2be-668b-469d-af1d-6c30a353b29b" status: 200 len: 286 microversion: 2.1 time: 0.034589 Jun 07 22:15:43.633410 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 674/1371] 10.222.0.13 () {58 vars in 1250 bytes} [Tue Jun 7 22:15:43 2022] GET /compute/v2.1/os-snapshots/35f8f2be-668b-469d-af1d-6c30a353b29b => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 22:15:44.077366 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-e38dc643-1401-446b-9c22-c4c72283b7d6 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:44.077977 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-e38dc643-1401-446b-9c22-c4c72283b7d6 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: 396f0b5c-2d4c-486e-9ab6-b781fc612a4a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:15:44.084528 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e38dc643-1401-446b-9c22-c4c72283b7d6 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:44.084974 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e38dc643-1401-446b-9c22-c4c72283b7d6 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:44.085731 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e38dc643-1401-446b-9c22-c4c72283b7d6 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:44.086161 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-e38dc643-1401-446b-9c22-c4c72283b7d6 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:44.213705 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-e38dc643-1401-446b-9c22-c4c72283b7d6 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:15:44.221102 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-e38dc643-1401-446b-9c22-c4c72283b7d6 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/396f0b5c-2d4c-486e-9ab6-b781fc612a4a" status: 200 len: 1580 microversion: 2.1 time: 0.148064 Jun 07 22:15:44.221663 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 698/1372] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:15:44 2022] GET /compute/v2.1/servers/396f0b5c-2d4c-486e-9ab6-b781fc612a4a => generated 1580 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:15:44.472041 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-e12f4d73-3685-43db-b1f0-b1fb112675b7 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:44.472640 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-e12f4d73-3685-43db-b1f0-b1fb112675b7 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] [instance: 4d8ab38f-db6d-4560-962e-c1e55c509ce1] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:15:44.480039 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e12f4d73-3685-43db-b1f0-b1fb112675b7 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:44.480478 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e12f4d73-3685-43db-b1f0-b1fb112675b7 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:44.481218 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e12f4d73-3685-43db-b1f0-b1fb112675b7 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:44.481644 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e12f4d73-3685-43db-b1f0-b1fb112675b7 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:44.609896 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-e12f4d73-3685-43db-b1f0-b1fb112675b7 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e8c46b1820a4ce5ac853ab1cc88fc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98914183afee4e58ad7a425cb019e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:15:44.617565 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-e12f4d73-3685-43db-b1f0-b1fb112675b7 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] 10.222.0.13 "GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1" status: 200 len: 1569 microversion: 2.1 time: 0.149870 Jun 07 22:15:44.618130 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 675/1373] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:15:44 2022] GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:15:44.644454 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-8fc0e07a-7616-462a-ac1d-1b14ef7bcd17 tempest-VolumesSnapshotsTestJSON-2141719477 tempest-VolumesSnapshotsTestJSON-2141719477-project] Calling method '.version_select at 0x7f92f6719ca0>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:44.674314 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-8fc0e07a-7616-462a-ac1d-1b14ef7bcd17 tempest-VolumesSnapshotsTestJSON-2141719477 tempest-VolumesSnapshotsTestJSON-2141719477-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/35f8f2be-668b-469d-af1d-6c30a353b29b" status: 200 len: 286 microversion: 2.1 time: 0.033743 Jun 07 22:15:44.674946 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 699/1374] 10.222.0.13 () {58 vars in 1250 bytes} [Tue Jun 7 22:15:44 2022] GET /compute/v2.1/os-snapshots/35f8f2be-668b-469d-af1d-6c30a353b29b => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:15:45.240112 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-822344bd-ba2c-4639-85a3-4d4a1cff316a tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:45.240731 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-822344bd-ba2c-4639-85a3-4d4a1cff316a tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: 396f0b5c-2d4c-486e-9ab6-b781fc612a4a] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:15:45.246948 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-822344bd-ba2c-4639-85a3-4d4a1cff316a tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:45.247422 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-822344bd-ba2c-4639-85a3-4d4a1cff316a tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:45.248181 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-822344bd-ba2c-4639-85a3-4d4a1cff316a tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:45.248615 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-822344bd-ba2c-4639-85a3-4d4a1cff316a tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:45.378101 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-822344bd-ba2c-4639-85a3-4d4a1cff316a tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:15:45.386158 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-822344bd-ba2c-4639-85a3-4d4a1cff316a tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/396f0b5c-2d4c-486e-9ab6-b781fc612a4a" status: 200 len: 1580 microversion: 2.1 time: 0.150953 Jun 07 22:15:45.386713 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 676/1375] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:15:45 2022] GET /compute/v2.1/servers/396f0b5c-2d4c-486e-9ab6-b781fc612a4a => generated 1580 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:15:45.634159 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-dcb6c710-4ec7-4305-9d5e-d8015336a142 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:45.634795 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-dcb6c710-4ec7-4305-9d5e-d8015336a142 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] [instance: 4d8ab38f-db6d-4560-962e-c1e55c509ce1] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:15:45.640781 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-dcb6c710-4ec7-4305-9d5e-d8015336a142 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:45.641225 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-dcb6c710-4ec7-4305-9d5e-d8015336a142 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:45.641969 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-dcb6c710-4ec7-4305-9d5e-d8015336a142 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:45.642400 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-dcb6c710-4ec7-4305-9d5e-d8015336a142 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:45.685846 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-41f4d9f1-a471-4c7d-8b8c-645693c438ce tempest-VolumesSnapshotsTestJSON-2141719477 tempest-VolumesSnapshotsTestJSON-2141719477-project] Calling method '.version_select at 0x7f92f0f6cd30>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:45.715966 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-41f4d9f1-a471-4c7d-8b8c-645693c438ce tempest-VolumesSnapshotsTestJSON-2141719477 tempest-VolumesSnapshotsTestJSON-2141719477-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/35f8f2be-668b-469d-af1d-6c30a353b29b" status: 200 len: 286 microversion: 2.1 time: 0.033861 Jun 07 22:15:45.716654 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 677/1376] 10.222.0.13 () {58 vars in 1250 bytes} [Tue Jun 7 22:15:45 2022] GET /compute/v2.1/os-snapshots/35f8f2be-668b-469d-af1d-6c30a353b29b => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 22:15:45.773725 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-dcb6c710-4ec7-4305-9d5e-d8015336a142 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e8c46b1820a4ce5ac853ab1cc88fc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98914183afee4e58ad7a425cb019e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:15:45.781506 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-dcb6c710-4ec7-4305-9d5e-d8015336a142 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] 10.222.0.13 "GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1" status: 200 len: 1569 microversion: 2.1 time: 0.151766 Jun 07 22:15:45.782065 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 700/1377] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:15:45 2022] GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:15:46.404389 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-68398cc7-4849-4822-8ac7-b5e69525c35f tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:46.404999 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-68398cc7-4849-4822-8ac7-b5e69525c35f tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: 396f0b5c-2d4c-486e-9ab6-b781fc612a4a] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:15:46.410987 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-68398cc7-4849-4822-8ac7-b5e69525c35f tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:46.411467 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-68398cc7-4849-4822-8ac7-b5e69525c35f tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:46.412214 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-68398cc7-4849-4822-8ac7-b5e69525c35f tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:46.412649 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-68398cc7-4849-4822-8ac7-b5e69525c35f tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:46.545127 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-68398cc7-4849-4822-8ac7-b5e69525c35f tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:15:46.553929 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-68398cc7-4849-4822-8ac7-b5e69525c35f tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/396f0b5c-2d4c-486e-9ab6-b781fc612a4a" status: 200 len: 1580 microversion: 2.1 time: 0.153898 Jun 07 22:15:46.554499 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 678/1378] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:15:46 2022] GET /compute/v2.1/servers/396f0b5c-2d4c-486e-9ab6-b781fc612a4a => generated 1580 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:15:46.727537 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-bba2b4f8-1d2f-4e4f-a582-4662c2602514 tempest-VolumesSnapshotsTestJSON-2141719477 tempest-VolumesSnapshotsTestJSON-2141719477-project] Calling method '.version_select at 0x7f92f13c45e0>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:46.757883 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-bba2b4f8-1d2f-4e4f-a582-4662c2602514 tempest-VolumesSnapshotsTestJSON-2141719477 tempest-VolumesSnapshotsTestJSON-2141719477-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/35f8f2be-668b-469d-af1d-6c30a353b29b" status: 200 len: 286 microversion: 2.1 time: 0.034213 Jun 07 22:15:46.758632 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 701/1379] 10.222.0.13 () {58 vars in 1250 bytes} [Tue Jun 7 22:15:46 2022] GET /compute/v2.1/os-snapshots/35f8f2be-668b-469d-af1d-6c30a353b29b => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:15:46.799084 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-653c97df-acb2-464f-9998-3691cd6a61d4 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:46.799736 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-653c97df-acb2-464f-9998-3691cd6a61d4 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] [instance: 4d8ab38f-db6d-4560-962e-c1e55c509ce1] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:15:46.806352 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-653c97df-acb2-464f-9998-3691cd6a61d4 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:46.806804 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-653c97df-acb2-464f-9998-3691cd6a61d4 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:46.807588 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-653c97df-acb2-464f-9998-3691cd6a61d4 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:46.808029 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-653c97df-acb2-464f-9998-3691cd6a61d4 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:46.936510 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-653c97df-acb2-464f-9998-3691cd6a61d4 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e8c46b1820a4ce5ac853ab1cc88fc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98914183afee4e58ad7a425cb019e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:15:46.944342 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-653c97df-acb2-464f-9998-3691cd6a61d4 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] 10.222.0.13 "GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1" status: 200 len: 1569 microversion: 2.1 time: 0.149102 Jun 07 22:15:46.944900 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 679/1380] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:15:46 2022] GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:15:47.572180 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-98ecd6f9-7a53-4081-8abc-e176e97829ea tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:47.572813 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-98ecd6f9-7a53-4081-8abc-e176e97829ea tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: 396f0b5c-2d4c-486e-9ab6-b781fc612a4a] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:15:47.578728 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-98ecd6f9-7a53-4081-8abc-e176e97829ea tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:47.579174 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-98ecd6f9-7a53-4081-8abc-e176e97829ea tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:47.580117 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-98ecd6f9-7a53-4081-8abc-e176e97829ea tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:47.580375 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-98ecd6f9-7a53-4081-8abc-e176e97829ea tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:47.715725 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-98ecd6f9-7a53-4081-8abc-e176e97829ea tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:15:47.723350 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-98ecd6f9-7a53-4081-8abc-e176e97829ea tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/396f0b5c-2d4c-486e-9ab6-b781fc612a4a" status: 200 len: 1580 microversion: 2.1 time: 0.155318 Jun 07 22:15:47.723917 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 702/1381] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:15:47 2022] GET /compute/v2.1/servers/396f0b5c-2d4c-486e-9ab6-b781fc612a4a => generated 1580 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:15:47.770457 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-ff7ae944-8c21-45c4-9f6d-74dcd3356b62 tempest-VolumesSnapshotsTestJSON-2141719477 tempest-VolumesSnapshotsTestJSON-2141719477-project] Calling method '.version_select at 0x7f92f0fb2700>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:47.799979 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-ff7ae944-8c21-45c4-9f6d-74dcd3356b62 tempest-VolumesSnapshotsTestJSON-2141719477 tempest-VolumesSnapshotsTestJSON-2141719477-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/35f8f2be-668b-469d-af1d-6c30a353b29b" status: 200 len: 286 microversion: 2.1 time: 0.034394 Jun 07 22:15:47.804403 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 680/1382] 10.222.0.13 () {58 vars in 1250 bytes} [Tue Jun 7 22:15:47 2022] GET /compute/v2.1/os-snapshots/35f8f2be-668b-469d-af1d-6c30a353b29b => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 22:15:47.961874 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-4c453348-7db8-4675-8c75-f2b20195f4a5 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:47.962591 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-4c453348-7db8-4675-8c75-f2b20195f4a5 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] [instance: 4d8ab38f-db6d-4560-962e-c1e55c509ce1] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:15:47.970683 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-4c453348-7db8-4675-8c75-f2b20195f4a5 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:47.971127 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-4c453348-7db8-4675-8c75-f2b20195f4a5 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:47.971951 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-4c453348-7db8-4675-8c75-f2b20195f4a5 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:47.972385 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-4c453348-7db8-4675-8c75-f2b20195f4a5 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:48.106176 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-4c453348-7db8-4675-8c75-f2b20195f4a5 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e8c46b1820a4ce5ac853ab1cc88fc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98914183afee4e58ad7a425cb019e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:15:48.114103 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-4c453348-7db8-4675-8c75-f2b20195f4a5 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] 10.222.0.13 "GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1" status: 200 len: 1569 microversion: 2.1 time: 0.156338 Jun 07 22:15:48.114674 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 703/1383] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:15:47 2022] GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:15:48.741340 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-65c6a304-b6d2-4b93-85f8-c6dd43b785eb tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:48.741861 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-65c6a304-b6d2-4b93-85f8-c6dd43b785eb tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: 396f0b5c-2d4c-486e-9ab6-b781fc612a4a] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:15:48.747861 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-65c6a304-b6d2-4b93-85f8-c6dd43b785eb tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:48.748306 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-65c6a304-b6d2-4b93-85f8-c6dd43b785eb tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:48.749058 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-65c6a304-b6d2-4b93-85f8-c6dd43b785eb tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:48.749489 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-65c6a304-b6d2-4b93-85f8-c6dd43b785eb tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:48.811979 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-e2dd274e-74a9-4efa-b13b-aa50c0e8b6df tempest-VolumesSnapshotsTestJSON-2141719477 tempest-VolumesSnapshotsTestJSON-2141719477-project] Calling method '.version_select at 0x7f92f671a310>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:48.841917 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-e2dd274e-74a9-4efa-b13b-aa50c0e8b6df tempest-VolumesSnapshotsTestJSON-2141719477 tempest-VolumesSnapshotsTestJSON-2141719477-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/35f8f2be-668b-469d-af1d-6c30a353b29b" status: 200 len: 287 microversion: 2.1 time: 0.033662 Jun 07 22:15:48.842475 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 704/1384] 10.222.0.13 () {58 vars in 1250 bytes} [Tue Jun 7 22:15:48 2022] GET /compute/v2.1/os-snapshots/35f8f2be-668b-469d-af1d-6c30a353b29b => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 22:15:48.852228 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-d9db13fd-084b-4f97-a539-dca49b1998c5 tempest-VolumesSnapshotsTestJSON-2141719477 tempest-VolumesSnapshotsTestJSON-2141719477-project] Calling method '.version_select at 0x7f92f671a040>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:48.886331 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-65c6a304-b6d2-4b93-85f8-c6dd43b785eb tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:15:48.893817 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-65c6a304-b6d2-4b93-85f8-c6dd43b785eb tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/396f0b5c-2d4c-486e-9ab6-b781fc612a4a" status: 200 len: 1580 microversion: 2.1 time: 0.156888 Jun 07 22:15:48.894603 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 681/1385] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:15:48 2022] GET /compute/v2.1/servers/396f0b5c-2d4c-486e-9ab6-b781fc612a4a => generated 1580 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:15:48.910564 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-d9db13fd-084b-4f97-a539-dca49b1998c5 tempest-VolumesSnapshotsTestJSON-2141719477 tempest-VolumesSnapshotsTestJSON-2141719477-project] 10.222.0.13 "DELETE /compute/v2.1/os-snapshots/35f8f2be-668b-469d-af1d-6c30a353b29b" status: 202 len: 0 microversion: 2.1 time: 0.061714 Jun 07 22:15:48.911425 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 705/1386] 10.222.0.13 () {58 vars in 1253 bytes} [Tue Jun 7 22:15:48 2022] DELETE /compute/v2.1/os-snapshots/35f8f2be-668b-469d-af1d-6c30a353b29b => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 07 22:15:48.922360 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-b38077bb-1862-4131-b3e1-e03856195cc0 tempest-VolumesSnapshotsTestJSON-2141719477 tempest-VolumesSnapshotsTestJSON-2141719477-project] Calling method '.version_select at 0x7f92f0f6cd30>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:48.955898 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-b38077bb-1862-4131-b3e1-e03856195cc0 tempest-VolumesSnapshotsTestJSON-2141719477 tempest-VolumesSnapshotsTestJSON-2141719477-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/35f8f2be-668b-469d-af1d-6c30a353b29b" status: 200 len: 286 microversion: 2.1 time: 0.039622 Jun 07 22:15:48.956465 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 682/1387] 10.222.0.13 () {58 vars in 1250 bytes} [Tue Jun 7 22:15:48 2022] GET /compute/v2.1/os-snapshots/35f8f2be-668b-469d-af1d-6c30a353b29b => generated 286 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:15:49.131152 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-fede8beb-3735-4481-acb5-60d778c9c3b5 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:49.131798 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-fede8beb-3735-4481-acb5-60d778c9c3b5 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] [instance: 4d8ab38f-db6d-4560-962e-c1e55c509ce1] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:15:49.138321 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-fede8beb-3735-4481-acb5-60d778c9c3b5 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:49.138768 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-fede8beb-3735-4481-acb5-60d778c9c3b5 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:49.139555 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-fede8beb-3735-4481-acb5-60d778c9c3b5 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:49.139986 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-fede8beb-3735-4481-acb5-60d778c9c3b5 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:49.272378 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-fede8beb-3735-4481-acb5-60d778c9c3b5 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e8c46b1820a4ce5ac853ab1cc88fc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98914183afee4e58ad7a425cb019e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:15:49.281292 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-fede8beb-3735-4481-acb5-60d778c9c3b5 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] 10.222.0.13 "GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1" status: 200 len: 1569 microversion: 2.1 time: 0.154624 Jun 07 22:15:49.282412 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 706/1388] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:15:49 2022] GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:15:49.913651 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-3b5bfc9f-7a62-414a-a2e7-d4c35bed549d tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:49.914260 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-3b5bfc9f-7a62-414a-a2e7-d4c35bed549d tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: 396f0b5c-2d4c-486e-9ab6-b781fc612a4a] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:15:49.920266 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-3b5bfc9f-7a62-414a-a2e7-d4c35bed549d tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:49.920711 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-3b5bfc9f-7a62-414a-a2e7-d4c35bed549d tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:49.921458 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-3b5bfc9f-7a62-414a-a2e7-d4c35bed549d tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:49.921900 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-3b5bfc9f-7a62-414a-a2e7-d4c35bed549d tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:49.967660 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-f7697f2b-11d3-473e-bfdb-d0e5fe489749 tempest-VolumesSnapshotsTestJSON-2141719477 tempest-VolumesSnapshotsTestJSON-2141719477-project] Calling method '.version_select at 0x7f92f6766ee0>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:49.994661 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.wsgi [None req-f7697f2b-11d3-473e-bfdb-d0e5fe489749 tempest-VolumesSnapshotsTestJSON-2141719477 tempest-VolumesSnapshotsTestJSON-2141719477-project] HTTP exception thrown: Snapshot 35f8f2be-668b-469d-af1d-6c30a353b29b could not be found. Jun 07 22:15:49.997657 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-f7697f2b-11d3-473e-bfdb-d0e5fe489749 tempest-VolumesSnapshotsTestJSON-2141719477 tempest-VolumesSnapshotsTestJSON-2141719477-project] Request method failure captured: Jun 07 22:15:49.997657 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: request: GET /compute/v2.1/os-snapshots/35f8f2be-668b-469d-af1d-6c30a353b29b HTTP/1.1 Jun 07 22:15:49.997657 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Accept: application/json Jun 07 22:15:49.997657 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Accept-Encoding: identity Jun 07 22:15:49.997657 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Connection: close Jun 07 22:15:49.997657 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Content-Length: 0 Jun 07 22:15:49.997657 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Content-Type: application/json Jun 07 22:15:49.997657 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Host: 10.222.0.13 Jun 07 22:15:49.997657 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Openstack-System-Scope: None Jun 07 22:15:49.997657 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: User-Agent: python-urllib3/1.26.9 Jun 07 22:15:49.997657 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Auth-Token: gAAAAABin84Nfn-P_xsgAK_C5zeP99k-367lNMma4sragyTxpxda2SrrAjzBh2LLM1SiYrwfTNKQ2c6ZkBeMuHSBVGFZAuNciedLR6c55Qpyyp4IGMcE_pJFp4_0JjD6ZpETl9qLRV4Zh1mHpkdooEdegmC58IhphxRpGWnnVE38yjNmZROFqJQ Jun 07 22:15:49.997657 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Domain-Id: None Jun 07 22:15:49.997657 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Domain-Name: None Jun 07 22:15:49.997657 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Identity-Status: Confirmed Jun 07 22:15:49.997657 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Is-Admin-Project: True Jun 07 22:15:49.997657 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Domain-Id: default Jun 07 22:15:49.997657 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Domain-Name: Default Jun 07 22:15:49.997657 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Id: 7e5fc544bfe8474e84d120073e280797 Jun 07 22:15:49.997657 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2141719477 Jun 07 22:15:49.997657 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Role: member,reader Jun 07 22:15:49.997657 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Roles: member,reader Jun 07 22:15:49.999100 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7e5fc544bfe8474e84d120073e280797"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7e5fc544bfe8474e84d120073e280797"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7e5fc544bfe8474e84d120073e280797"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7e5fc544bfe8474e84d120073e280797"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}] Jun 07 22:15:49.999100 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2141719477 Jun 07 22:15:49.999100 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant-Id: 7e5fc544bfe8474e84d120073e280797 Jun 07 22:15:49.999100 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2141719477 Jun 07 22:15:49.999100 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User: tempest-VolumesSnapshotsTestJSON-2141719477-project Jun 07 22:15:49.999100 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Domain-Id: default Jun 07 22:15:49.999100 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Domain-Name: Default Jun 07 22:15:49.999100 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Id: 0121a67389b744119e0714acadb33b7f Jun 07 22:15:49.999100 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2141719477-project Jun 07 22:15:49.999100 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: method: Jun 07 22:15:49.999100 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: exception: Snapshot 35f8f2be-668b-469d-af1d-6c30a353b29b could not be found. Jun 07 22:15:49.999100 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: action_args: {'id': '35f8f2be-668b-469d-af1d-6c30a353b29b'} Jun 07 22:15:49.999100 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 22:15:50.000338 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:15:50.000338 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 07 22:15:50.000338 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 07 22:15:50.000338 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 07 22:15:50.000338 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 07 22:15:50.000338 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 07 22:15:50.000338 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 07 22:15:50.000338 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 22:15:50.000338 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 22:15:50.000338 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 22:15:50.000338 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 22:15:50.000338 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 22:15:50.000338 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 22:15:50.000338 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 22:15:50.000338 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 22:15:50.000338 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 35f8f2be-668b-469d-af1d-6c30a353b29b could not be found. (HTTP 404) (Request-ID: req-489fbf1b-bd0c-45e6-b27d-5ca4254c3e85) Jun 07 22:15:50.000338 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:15:50.000338 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:15:50.001533 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:15:50.001533 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:15:50.001533 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 07 22:15:50.001533 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 07 22:15:50.001533 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 07 22:15:50.001533 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 07 22:15:50.001533 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 07 22:15:50.001533 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 07 22:15:50.001533 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 07 22:15:50.001533 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 07 22:15:50.001533 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 07 22:15:50.001533 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 07 22:15:50.001533 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 07 22:15:50.001533 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 07 22:15:50.001533 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 07 22:15:50.001533 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 07 22:15:50.001533 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 22:15:50.001533 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 22:15:50.001533 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 22:15:50.002734 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 22:15:50.002734 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 22:15:50.002734 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 22:15:50.002734 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 22:15:50.002734 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 22:15:50.002734 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 35f8f2be-668b-469d-af1d-6c30a353b29b could not be found. Jun 07 22:15:50.002734 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:15:50.002734 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:15:50.002734 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:15:50.002734 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:15:50.002734 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:15:50.002734 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:15:50.002734 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 22:15:50.002734 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 22:15:50.002734 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 22:15:50.002734 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 22:15:50.002734 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 22:15:50.002734 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 22:15:50.002734 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 07 22:15:50.002734 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 22:15:50.006574 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 35f8f2be-668b-469d-af1d-6c30a353b29b could not be found. Jun 07 22:15:50.006574 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:15:50.006574 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:15:50.006574 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:15:50.006574 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:15:50.006574 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:15:50.006574 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:15:50.006574 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 22:15:50.006574 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 22:15:50.006574 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 35f8f2be-668b-469d-af1d-6c30a353b29b could not be found. Jun 07 22:15:50.006574 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:15:50.006574 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-f7697f2b-11d3-473e-bfdb-d0e5fe489749 tempest-VolumesSnapshotsTestJSON-2141719477 tempest-VolumesSnapshotsTestJSON-2141719477-project] Returning 404 to user: Snapshot 35f8f2be-668b-469d-af1d-6c30a353b29b could not be found. {{(pid=117971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 22:15:50.006574 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-f7697f2b-11d3-473e-bfdb-d0e5fe489749 tempest-VolumesSnapshotsTestJSON-2141719477 tempest-VolumesSnapshotsTestJSON-2141719477-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/35f8f2be-668b-469d-af1d-6c30a353b29b" status: 404 len: 111 microversion: 2.1 time: 0.035326 Jun 07 22:15:50.007639 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 707/1389] 10.222.0.13 () {58 vars in 1250 bytes} [Tue Jun 7 22:15:49 2022] GET /compute/v2.1/os-snapshots/35f8f2be-668b-469d-af1d-6c30a353b29b => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 07 22:15:50.009825 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-7b0243c1-92d5-42f2-bec5-0ac6a7263ad6 tempest-VolumesSnapshotsTestJSON-2141719477 tempest-VolumesSnapshotsTestJSON-2141719477-project] Calling method '.version_select at 0x7f92f671af70>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:50.079745 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-7b0243c1-92d5-42f2-bec5-0ac6a7263ad6 tempest-VolumesSnapshotsTestJSON-2141719477 tempest-VolumesSnapshotsTestJSON-2141719477-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/f224d195-7082-4829-a9bd-ce91548cccc6" status: 202 len: 0 microversion: 2.1 time: 0.073470 Jun 07 22:15:50.080615 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 708/1390] 10.222.0.13 () {58 vars in 1247 bytes} [Tue Jun 7 22:15:50 2022] DELETE /compute/v2.1/os-volumes/f224d195-7082-4829-a9bd-ce91548cccc6 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 22:15:50.091523 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-c9242dee-11cc-4c54-a378-03d8ba811391 tempest-VolumesSnapshotsTestJSON-2141719477 tempest-VolumesSnapshotsTestJSON-2141719477-project] Calling method '.version_select at 0x7f92f1489040>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:50.147159 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-3b5bfc9f-7a62-414a-a2e7-d4c35bed549d tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:15:50.149599 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-c9242dee-11cc-4c54-a378-03d8ba811391 tempest-VolumesSnapshotsTestJSON-2141719477 tempest-VolumesSnapshotsTestJSON-2141719477-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/f224d195-7082-4829-a9bd-ce91548cccc6" status: 200 len: 344 microversion: 2.1 time: 0.062663 Jun 07 22:15:50.150310 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 709/1391] 10.222.0.13 () {58 vars in 1244 bytes} [Tue Jun 7 22:15:50 2022] GET /compute/v2.1/os-volumes/f224d195-7082-4829-a9bd-ce91548cccc6 => generated 344 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:15:50.156514 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-3b5bfc9f-7a62-414a-a2e7-d4c35bed549d tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/396f0b5c-2d4c-486e-9ab6-b781fc612a4a" status: 200 len: 1461 microversion: 2.1 time: 0.247154 Jun 07 22:15:50.159521 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 683/1392] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:15:49 2022] GET /compute/v2.1/servers/396f0b5c-2d4c-486e-9ab6-b781fc612a4a => generated 1461 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:15:50.302586 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-ba2aacbc-f744-4811-88d1-5174a90df595 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:50.303195 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-ba2aacbc-f744-4811-88d1-5174a90df595 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] [instance: 4d8ab38f-db6d-4560-962e-c1e55c509ce1] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:15:50.309212 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ba2aacbc-f744-4811-88d1-5174a90df595 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:50.309662 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ba2aacbc-f744-4811-88d1-5174a90df595 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:50.310416 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ba2aacbc-f744-4811-88d1-5174a90df595 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:50.310845 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-ba2aacbc-f744-4811-88d1-5174a90df595 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:50.454813 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-ba2aacbc-f744-4811-88d1-5174a90df595 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e8c46b1820a4ce5ac853ab1cc88fc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98914183afee4e58ad7a425cb019e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:15:50.465386 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-ba2aacbc-f744-4811-88d1-5174a90df595 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] 10.222.0.13 "GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1" status: 200 len: 1569 microversion: 2.1 time: 0.166801 Jun 07 22:15:50.466070 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 710/1393] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:15:50 2022] GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1 => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:15:50.526605 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [req-a15cdec3-8f50-4bac-95c3-3946a0bec160 req-f20257db-577f-4aea-90da-0a24ea9e6c2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "396f0b5c-2d4c-486e-9ab6-b781fc612a4a", "name": "network-vif-deleted", "tag": "5b7c7edd-c543-41ae-bf73-9c85442dfb14"}]} {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:15:50.536534 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [req-a15cdec3-8f50-4bac-95c3-3946a0bec160 req-f20257db-577f-4aea-90da-0a24ea9e6c2c service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:50.537049 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [req-a15cdec3-8f50-4bac-95c3-3946a0bec160 req-f20257db-577f-4aea-90da-0a24ea9e6c2c service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:50.550540 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.compute.server_external_events [req-a15cdec3-8f50-4bac-95c3-3946a0bec160 req-f20257db-577f-4aea-90da-0a24ea9e6c2c service nova] Creating event network-vif-deleted:5b7c7edd-c543-41ae-bf73-9c85442dfb14 for instance 396f0b5c-2d4c-486e-9ab6-b781fc612a4a on hv-cinder-83552 Jun 07 22:15:50.555752 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [req-a15cdec3-8f50-4bac-95c3-3946a0bec160 req-f20257db-577f-4aea-90da-0a24ea9e6c2c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032925 Jun 07 22:15:50.556440 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 684/1394] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:15:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 22:15:51.162471 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-6b44275c-6fd1-4747-980c-4d810e1d9780 tempest-VolumesSnapshotsTestJSON-2141719477 tempest-VolumesSnapshotsTestJSON-2141719477-project] Calling method '.version_select at 0x7f92f67195e0>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:51.174500 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-95b5b6ea-58b2-455a-ba64-8fd33319c797 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:51.175130 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-95b5b6ea-58b2-455a-ba64-8fd33319c797 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: 396f0b5c-2d4c-486e-9ab6-b781fc612a4a] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:15:51.182729 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-95b5b6ea-58b2-455a-ba64-8fd33319c797 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:51.183266 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-95b5b6ea-58b2-455a-ba64-8fd33319c797 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:51.184077 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-95b5b6ea-58b2-455a-ba64-8fd33319c797 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:51.184507 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-95b5b6ea-58b2-455a-ba64-8fd33319c797 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:51.189968 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.wsgi [None req-6b44275c-6fd1-4747-980c-4d810e1d9780 tempest-VolumesSnapshotsTestJSON-2141719477 tempest-VolumesSnapshotsTestJSON-2141719477-project] HTTP exception thrown: Volume f224d195-7082-4829-a9bd-ce91548cccc6 could not be found. Jun 07 22:15:51.192824 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-6b44275c-6fd1-4747-980c-4d810e1d9780 tempest-VolumesSnapshotsTestJSON-2141719477 tempest-VolumesSnapshotsTestJSON-2141719477-project] Request method failure captured: Jun 07 22:15:51.192824 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: request: GET /compute/v2.1/os-volumes/f224d195-7082-4829-a9bd-ce91548cccc6 HTTP/1.1 Jun 07 22:15:51.192824 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Accept: application/json Jun 07 22:15:51.192824 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Accept-Encoding: identity Jun 07 22:15:51.192824 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Connection: close Jun 07 22:15:51.192824 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Content-Length: 0 Jun 07 22:15:51.192824 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Content-Type: application/json Jun 07 22:15:51.192824 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Host: 10.222.0.13 Jun 07 22:15:51.192824 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Openstack-System-Scope: None Jun 07 22:15:51.192824 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: User-Agent: python-urllib3/1.26.9 Jun 07 22:15:51.192824 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Auth-Token: gAAAAABin84Nfn-P_xsgAK_C5zeP99k-367lNMma4sragyTxpxda2SrrAjzBh2LLM1SiYrwfTNKQ2c6ZkBeMuHSBVGFZAuNciedLR6c55Qpyyp4IGMcE_pJFp4_0JjD6ZpETl9qLRV4Zh1mHpkdooEdegmC58IhphxRpGWnnVE38yjNmZROFqJQ Jun 07 22:15:51.192824 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Domain-Id: None Jun 07 22:15:51.192824 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Domain-Name: None Jun 07 22:15:51.192824 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Identity-Status: Confirmed Jun 07 22:15:51.192824 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Is-Admin-Project: True Jun 07 22:15:51.192824 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Domain-Id: default Jun 07 22:15:51.192824 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Domain-Name: Default Jun 07 22:15:51.192824 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Id: 7e5fc544bfe8474e84d120073e280797 Jun 07 22:15:51.192824 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2141719477 Jun 07 22:15:51.192824 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Role: member,reader Jun 07 22:15:51.192824 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Roles: member,reader Jun 07 22:15:51.194817 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7e5fc544bfe8474e84d120073e280797"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7e5fc544bfe8474e84d120073e280797"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7e5fc544bfe8474e84d120073e280797"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7e5fc544bfe8474e84d120073e280797"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}] Jun 07 22:15:51.194817 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2141719477 Jun 07 22:15:51.194817 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant-Id: 7e5fc544bfe8474e84d120073e280797 Jun 07 22:15:51.194817 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2141719477 Jun 07 22:15:51.194817 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User: tempest-VolumesSnapshotsTestJSON-2141719477-project Jun 07 22:15:51.194817 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Domain-Id: default Jun 07 22:15:51.194817 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Domain-Name: Default Jun 07 22:15:51.194817 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Id: 0121a67389b744119e0714acadb33b7f Jun 07 22:15:51.194817 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2141719477-project Jun 07 22:15:51.194817 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: method: Jun 07 22:15:51.194817 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: exception: Volume f224d195-7082-4829-a9bd-ce91548cccc6 could not be found. Jun 07 22:15:51.194817 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: action_args: {'id': 'f224d195-7082-4829-a9bd-ce91548cccc6'} Jun 07 22:15:51.194817 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 22:15:51.195753 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:15:51.195753 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 22:15:51.195753 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 22:15:51.195753 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 07 22:15:51.195753 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 07 22:15:51.195753 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 07 22:15:51.195753 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 07 22:15:51.195753 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 22:15:51.195753 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 22:15:51.195753 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 22:15:51.195753 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 22:15:51.195753 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 22:15:51.195753 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 22:15:51.195753 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 22:15:51.195753 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 22:15:51.195753 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f224d195-7082-4829-a9bd-ce91548cccc6 could not be found. (HTTP 404) (Request-ID: req-b26d8e4e-c712-4b3f-87fb-b1a6ee1b714b) Jun 07 22:15:51.195753 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:15:51.195753 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:15:51.195753 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:15:51.196942 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:15:51.196942 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 07 22:15:51.196942 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 07 22:15:51.196942 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 07 22:15:51.196942 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 07 22:15:51.196942 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 07 22:15:51.196942 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 07 22:15:51.196942 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 07 22:15:51.196942 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 07 22:15:51.196942 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 22:15:51.196942 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 22:15:51.196942 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 07 22:15:51.196942 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 07 22:15:51.196942 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 07 22:15:51.196942 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 07 22:15:51.196942 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 22:15:51.196942 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 22:15:51.196942 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 22:15:51.196942 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 22:15:51.198117 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 22:15:51.198117 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 22:15:51.198117 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 22:15:51.198117 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 22:15:51.198117 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f224d195-7082-4829-a9bd-ce91548cccc6 could not be found. Jun 07 22:15:51.198117 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:15:51.198117 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:15:51.198117 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:15:51.198117 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:15:51.198117 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:15:51.198117 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:15:51.198117 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 22:15:51.198117 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 22:15:51.198117 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 22:15:51.198117 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 22:15:51.198117 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 22:15:51.198117 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 22:15:51.198117 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 07 22:15:51.198117 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 22:15:51.199362 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f224d195-7082-4829-a9bd-ce91548cccc6 could not be found. Jun 07 22:15:51.199362 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:15:51.199362 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:15:51.199362 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:15:51.199362 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:15:51.199362 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:15:51.199362 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:15:51.199362 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 22:15:51.199362 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 22:15:51.199362 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f224d195-7082-4829-a9bd-ce91548cccc6 could not be found. Jun 07 22:15:51.199362 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:15:51.199362 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-6b44275c-6fd1-4747-980c-4d810e1d9780 tempest-VolumesSnapshotsTestJSON-2141719477 tempest-VolumesSnapshotsTestJSON-2141719477-project] Returning 404 to user: Volume f224d195-7082-4829-a9bd-ce91548cccc6 could not be found. {{(pid=117971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 22:15:51.199362 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-6b44275c-6fd1-4747-980c-4d810e1d9780 tempest-VolumesSnapshotsTestJSON-2141719477 tempest-VolumesSnapshotsTestJSON-2141719477-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/f224d195-7082-4829-a9bd-ce91548cccc6" status: 404 len: 109 microversion: 2.1 time: 0.036060 Jun 07 22:15:51.199362 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 711/1395] 10.222.0.13 () {58 vars in 1244 bytes} [Tue Jun 7 22:15:51 2022] GET /compute/v2.1/os-volumes/f224d195-7082-4829-a9bd-ce91548cccc6 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 22:15:51.204927 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-50dc8f16-15cd-4a32-af4d-26dbd62a3fb0 tempest-VolumesSnapshotsTestJSON-2141719477 tempest-VolumesSnapshotsTestJSON-2141719477-project] Calling method '.version_select at 0x7f92f6750e50>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:51.220017 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-95b5b6ea-58b2-455a-ba64-8fd33319c797 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:51.220456 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-95b5b6ea-58b2-455a-ba64-8fd33319c797 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:51.220905 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.objects.instance [None req-95b5b6ea-58b2-455a-ba64-8fd33319c797 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lazy-loading 'fault' on Instance uuid 396f0b5c-2d4c-486e-9ab6-b781fc612a4a {{(pid=117970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 22:15:51.233763 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.wsgi [None req-50dc8f16-15cd-4a32-af4d-26dbd62a3fb0 tempest-VolumesSnapshotsTestJSON-2141719477 tempest-VolumesSnapshotsTestJSON-2141719477-project] HTTP exception thrown: Volume f224d195-7082-4829-a9bd-ce91548cccc6 could not be found. Jun 07 22:15:51.235760 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-50dc8f16-15cd-4a32-af4d-26dbd62a3fb0 tempest-VolumesSnapshotsTestJSON-2141719477 tempest-VolumesSnapshotsTestJSON-2141719477-project] Request method failure captured: Jun 07 22:15:51.235760 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: request: DELETE /compute/v2.1/os-volumes/f224d195-7082-4829-a9bd-ce91548cccc6 HTTP/1.1 Jun 07 22:15:51.235760 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Accept: application/json Jun 07 22:15:51.235760 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Accept-Encoding: identity Jun 07 22:15:51.235760 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Connection: close Jun 07 22:15:51.235760 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Content-Length: 0 Jun 07 22:15:51.235760 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Content-Type: application/json Jun 07 22:15:51.235760 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Host: 10.222.0.13 Jun 07 22:15:51.235760 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Openstack-System-Scope: None Jun 07 22:15:51.235760 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: User-Agent: python-urllib3/1.26.9 Jun 07 22:15:51.235760 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Auth-Token: gAAAAABin84Nfn-P_xsgAK_C5zeP99k-367lNMma4sragyTxpxda2SrrAjzBh2LLM1SiYrwfTNKQ2c6ZkBeMuHSBVGFZAuNciedLR6c55Qpyyp4IGMcE_pJFp4_0JjD6ZpETl9qLRV4Zh1mHpkdooEdegmC58IhphxRpGWnnVE38yjNmZROFqJQ Jun 07 22:15:51.235760 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Domain-Id: None Jun 07 22:15:51.235760 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Domain-Name: None Jun 07 22:15:51.235760 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Identity-Status: Confirmed Jun 07 22:15:51.235760 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Is-Admin-Project: True Jun 07 22:15:51.235760 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Domain-Id: default Jun 07 22:15:51.235760 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Domain-Name: Default Jun 07 22:15:51.235760 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Id: 7e5fc544bfe8474e84d120073e280797 Jun 07 22:15:51.235760 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2141719477 Jun 07 22:15:51.235760 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Role: member,reader Jun 07 22:15:51.235760 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Roles: member,reader Jun 07 22:15:51.237403 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7e5fc544bfe8474e84d120073e280797"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7e5fc544bfe8474e84d120073e280797"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7e5fc544bfe8474e84d120073e280797"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7e5fc544bfe8474e84d120073e280797"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}] Jun 07 22:15:51.237403 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2141719477 Jun 07 22:15:51.237403 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant-Id: 7e5fc544bfe8474e84d120073e280797 Jun 07 22:15:51.237403 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2141719477 Jun 07 22:15:51.237403 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User: tempest-VolumesSnapshotsTestJSON-2141719477-project Jun 07 22:15:51.237403 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Domain-Id: default Jun 07 22:15:51.237403 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Domain-Name: Default Jun 07 22:15:51.237403 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Id: 0121a67389b744119e0714acadb33b7f Jun 07 22:15:51.237403 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2141719477-project Jun 07 22:15:51.237403 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: method: Jun 07 22:15:51.237403 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: exception: Volume f224d195-7082-4829-a9bd-ce91548cccc6 could not be found. Jun 07 22:15:51.237403 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: action_args: {'id': 'f224d195-7082-4829-a9bd-ce91548cccc6'} Jun 07 22:15:51.237403 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 22:15:51.239113 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:15:51.239113 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 22:15:51.239113 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 22:15:51.239113 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 07 22:15:51.239113 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 07 22:15:51.239113 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 07 22:15:51.239113 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 07 22:15:51.239113 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 07 22:15:51.239113 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 07 22:15:51.239113 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 07 22:15:51.239113 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 07 22:15:51.239113 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 22:15:51.239113 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 22:15:51.239113 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 22:15:51.239113 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 22:15:51.239113 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f224d195-7082-4829-a9bd-ce91548cccc6 could not be found. (HTTP 404) (Request-ID: req-8cd9081b-e457-48a5-9ac2-028be890c1b7) Jun 07 22:15:51.239113 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:15:51.239113 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:15:51.239113 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:15:51.240582 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:15:51.240582 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 07 22:15:51.240582 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 07 22:15:51.240582 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 07 22:15:51.240582 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 07 22:15:51.240582 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 07 22:15:51.240582 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 07 22:15:51.240582 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 07 22:15:51.240582 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 07 22:15:51.240582 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 22:15:51.240582 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 22:15:51.240582 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 07 22:15:51.240582 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 07 22:15:51.240582 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 07 22:15:51.240582 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 07 22:15:51.240582 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 07 22:15:51.240582 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 07 22:15:51.240582 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 07 22:15:51.240582 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 07 22:15:51.242307 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 22:15:51.242307 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 22:15:51.242307 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 22:15:51.242307 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 22:15:51.242307 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f224d195-7082-4829-a9bd-ce91548cccc6 could not be found. Jun 07 22:15:51.242307 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:15:51.242307 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:15:51.242307 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:15:51.242307 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:15:51.242307 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:15:51.242307 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:15:51.242307 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 22:15:51.242307 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 22:15:51.242307 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 22:15:51.242307 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 22:15:51.242307 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 22:15:51.242307 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 22:15:51.242307 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 07 22:15:51.242307 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 22:15:51.243854 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f224d195-7082-4829-a9bd-ce91548cccc6 could not be found. Jun 07 22:15:51.243854 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:15:51.243854 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:15:51.243854 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:15:51.243854 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:15:51.243854 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:15:51.243854 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:15:51.243854 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 22:15:51.243854 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 22:15:51.243854 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f224d195-7082-4829-a9bd-ce91548cccc6 could not be found. Jun 07 22:15:51.243854 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:15:51.243854 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-50dc8f16-15cd-4a32-af4d-26dbd62a3fb0 tempest-VolumesSnapshotsTestJSON-2141719477 tempest-VolumesSnapshotsTestJSON-2141719477-project] Returning 404 to user: Volume f224d195-7082-4829-a9bd-ce91548cccc6 could not be found. {{(pid=117971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 22:15:51.243854 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-50dc8f16-15cd-4a32-af4d-26dbd62a3fb0 tempest-VolumesSnapshotsTestJSON-2141719477 tempest-VolumesSnapshotsTestJSON-2141719477-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/f224d195-7082-4829-a9bd-ce91548cccc6" status: 404 len: 109 microversion: 2.1 time: 0.036133 Jun 07 22:15:51.244927 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 712/1396] 10.222.0.13 () {58 vars in 1247 bytes} [Tue Jun 7 22:15:51 2022] DELETE /compute/v2.1/os-volumes/f224d195-7082-4829-a9bd-ce91548cccc6 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 07 22:15:51.251418 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-e6592ea5-671e-423e-a724-e6998d88db9b tempest-VolumesSnapshotsTestJSON-2141719477 tempest-VolumesSnapshotsTestJSON-2141719477-project] Calling method '.version_select at 0x7f92f142ef70>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:51.273932 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.wsgi [None req-e6592ea5-671e-423e-a724-e6998d88db9b tempest-VolumesSnapshotsTestJSON-2141719477 tempest-VolumesSnapshotsTestJSON-2141719477-project] HTTP exception thrown: Volume f224d195-7082-4829-a9bd-ce91548cccc6 could not be found. Jun 07 22:15:51.275413 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-e6592ea5-671e-423e-a724-e6998d88db9b tempest-VolumesSnapshotsTestJSON-2141719477 tempest-VolumesSnapshotsTestJSON-2141719477-project] Request method failure captured: Jun 07 22:15:51.275413 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: request: GET /compute/v2.1/os-volumes/f224d195-7082-4829-a9bd-ce91548cccc6 HTTP/1.1 Jun 07 22:15:51.275413 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Accept: application/json Jun 07 22:15:51.275413 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Accept-Encoding: identity Jun 07 22:15:51.275413 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Connection: close Jun 07 22:15:51.275413 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Content-Length: 0 Jun 07 22:15:51.275413 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Content-Type: application/json Jun 07 22:15:51.275413 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Host: 10.222.0.13 Jun 07 22:15:51.275413 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Openstack-System-Scope: None Jun 07 22:15:51.275413 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: User-Agent: python-urllib3/1.26.9 Jun 07 22:15:51.275413 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Auth-Token: gAAAAABin84Nfn-P_xsgAK_C5zeP99k-367lNMma4sragyTxpxda2SrrAjzBh2LLM1SiYrwfTNKQ2c6ZkBeMuHSBVGFZAuNciedLR6c55Qpyyp4IGMcE_pJFp4_0JjD6ZpETl9qLRV4Zh1mHpkdooEdegmC58IhphxRpGWnnVE38yjNmZROFqJQ Jun 07 22:15:51.275413 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Domain-Id: None Jun 07 22:15:51.275413 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Domain-Name: None Jun 07 22:15:51.275413 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Identity-Status: Confirmed Jun 07 22:15:51.275413 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Is-Admin-Project: True Jun 07 22:15:51.275413 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Domain-Id: default Jun 07 22:15:51.275413 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Domain-Name: Default Jun 07 22:15:51.275413 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Id: 7e5fc544bfe8474e84d120073e280797 Jun 07 22:15:51.275413 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2141719477 Jun 07 22:15:51.275413 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Role: member,reader Jun 07 22:15:51.275413 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Roles: member,reader Jun 07 22:15:51.276953 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7e5fc544bfe8474e84d120073e280797"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7e5fc544bfe8474e84d120073e280797"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7e5fc544bfe8474e84d120073e280797"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7e5fc544bfe8474e84d120073e280797"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}] Jun 07 22:15:51.276953 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2141719477 Jun 07 22:15:51.276953 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant-Id: 7e5fc544bfe8474e84d120073e280797 Jun 07 22:15:51.276953 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2141719477 Jun 07 22:15:51.276953 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User: tempest-VolumesSnapshotsTestJSON-2141719477-project Jun 07 22:15:51.276953 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Domain-Id: default Jun 07 22:15:51.276953 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Domain-Name: Default Jun 07 22:15:51.276953 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Id: 0121a67389b744119e0714acadb33b7f Jun 07 22:15:51.276953 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2141719477-project Jun 07 22:15:51.276953 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: method: Jun 07 22:15:51.276953 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: exception: Volume f224d195-7082-4829-a9bd-ce91548cccc6 could not be found. Jun 07 22:15:51.276953 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: action_args: {'id': 'f224d195-7082-4829-a9bd-ce91548cccc6'} Jun 07 22:15:51.276953 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 22:15:51.281208 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:15:51.281208 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 22:15:51.281208 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 22:15:51.281208 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 07 22:15:51.281208 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 07 22:15:51.281208 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 07 22:15:51.281208 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 07 22:15:51.281208 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 22:15:51.281208 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 22:15:51.281208 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 22:15:51.281208 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 22:15:51.281208 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 22:15:51.281208 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 22:15:51.281208 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 22:15:51.281208 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 22:15:51.281208 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f224d195-7082-4829-a9bd-ce91548cccc6 could not be found. (HTTP 404) (Request-ID: req-b2e9c0b6-1b4e-4003-b367-e973ab813029) Jun 07 22:15:51.281208 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:15:51.281208 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:15:51.281208 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:15:51.282413 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:15:51.282413 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 07 22:15:51.282413 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 07 22:15:51.282413 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 07 22:15:51.282413 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 07 22:15:51.282413 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 07 22:15:51.282413 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 07 22:15:51.282413 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 07 22:15:51.282413 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 07 22:15:51.282413 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 22:15:51.282413 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 22:15:51.282413 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 07 22:15:51.282413 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 07 22:15:51.282413 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 07 22:15:51.282413 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 07 22:15:51.282413 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 22:15:51.282413 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 22:15:51.282413 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 22:15:51.282413 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 22:15:51.284427 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 22:15:51.284427 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 22:15:51.284427 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 22:15:51.284427 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 22:15:51.284427 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f224d195-7082-4829-a9bd-ce91548cccc6 could not be found. Jun 07 22:15:51.284427 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:15:51.284427 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:15:51.284427 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:15:51.284427 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:15:51.284427 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:15:51.284427 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:15:51.284427 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 22:15:51.284427 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 22:15:51.284427 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 22:15:51.284427 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 22:15:51.284427 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 22:15:51.284427 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 22:15:51.284427 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 07 22:15:51.284427 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 22:15:51.287589 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f224d195-7082-4829-a9bd-ce91548cccc6 could not be found. Jun 07 22:15:51.287589 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:15:51.287589 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:15:51.287589 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:15:51.287589 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:15:51.287589 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:15:51.287589 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:15:51.287589 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 22:15:51.287589 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 22:15:51.287589 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f224d195-7082-4829-a9bd-ce91548cccc6 could not be found. Jun 07 22:15:51.287589 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:15:51.287589 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-e6592ea5-671e-423e-a724-e6998d88db9b tempest-VolumesSnapshotsTestJSON-2141719477 tempest-VolumesSnapshotsTestJSON-2141719477-project] Returning 404 to user: Volume f224d195-7082-4829-a9bd-ce91548cccc6 could not be found. {{(pid=117971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 22:15:51.290627 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-95b5b6ea-58b2-455a-ba64-8fd33319c797 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:15:51.291749 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-e6592ea5-671e-423e-a724-e6998d88db9b tempest-VolumesSnapshotsTestJSON-2141719477 tempest-VolumesSnapshotsTestJSON-2141719477-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/f224d195-7082-4829-a9bd-ce91548cccc6" status: 404 len: 109 microversion: 2.1 time: 0.034662 Jun 07 22:15:51.291749 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 713/1397] 10.222.0.13 () {58 vars in 1244 bytes} [Tue Jun 7 22:15:51 2022] GET /compute/v2.1/os-volumes/f224d195-7082-4829-a9bd-ce91548cccc6 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 22:15:51.292038 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-95b5b6ea-58b2-455a-ba64-8fd33319c797 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/396f0b5c-2d4c-486e-9ab6-b781fc612a4a" status: 200 len: 1231 microversion: 2.1 time: 0.115443 Jun 07 22:15:51.303683 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 685/1398] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:15:51 2022] GET /compute/v2.1/servers/396f0b5c-2d4c-486e-9ab6-b781fc612a4a => generated 1231 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:15:51.487706 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-998d9650-73cf-4399-8eb7-ebf2839be2cd tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:51.488971 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-998d9650-73cf-4399-8eb7-ebf2839be2cd tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] [instance: 4d8ab38f-db6d-4560-962e-c1e55c509ce1] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:15:51.495025 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-998d9650-73cf-4399-8eb7-ebf2839be2cd tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:51.495585 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-998d9650-73cf-4399-8eb7-ebf2839be2cd tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:51.496413 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-998d9650-73cf-4399-8eb7-ebf2839be2cd tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:51.497038 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-998d9650-73cf-4399-8eb7-ebf2839be2cd tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:51.632898 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-998d9650-73cf-4399-8eb7-ebf2839be2cd tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e8c46b1820a4ce5ac853ab1cc88fc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98914183afee4e58ad7a425cb019e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:15:51.642450 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-998d9650-73cf-4399-8eb7-ebf2839be2cd tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] 10.222.0.13 "GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1" status: 200 len: 1510 microversion: 2.1 time: 0.159353 Jun 07 22:15:51.643010 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 714/1399] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:15:51 2022] GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1 => generated 1510 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:15:51.658930 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-e60ccf93-c5d1-4a4a-b08d-41235df5fcf9 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:15:51.659600 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-e60ccf93-c5d1-4a4a-b08d-41235df5fcf9 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] [instance: 4d8ab38f-db6d-4560-962e-c1e55c509ce1] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:15:51.666301 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e60ccf93-c5d1-4a4a-b08d-41235df5fcf9 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:51.666840 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e60ccf93-c5d1-4a4a-b08d-41235df5fcf9 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:51.667814 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e60ccf93-c5d1-4a4a-b08d-41235df5fcf9 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:51.668342 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-e60ccf93-c5d1-4a4a-b08d-41235df5fcf9 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:51.746907 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-e60ccf93-c5d1-4a4a-b08d-41235df5fcf9 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] 10.222.0.13 "POST /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1/action" status: 202 len: 0 microversion: 2.1 time: 0.091810 Jun 07 22:15:51.750320 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 686/1400] 10.222.0.13 () {60 vars in 1277 bytes} [Tue Jun 7 22:15:51 2022] POST /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 22:15:51.755601 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-751a7921-c046-4a3f-99fa-d6bce67bd847 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:51.756533 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-751a7921-c046-4a3f-99fa-d6bce67bd847 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] [instance: 4d8ab38f-db6d-4560-962e-c1e55c509ce1] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:15:51.763450 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-751a7921-c046-4a3f-99fa-d6bce67bd847 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:51.763674 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-751a7921-c046-4a3f-99fa-d6bce67bd847 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:51.764668 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-751a7921-c046-4a3f-99fa-d6bce67bd847 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:51.765382 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-751a7921-c046-4a3f-99fa-d6bce67bd847 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:51.961638 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-751a7921-c046-4a3f-99fa-d6bce67bd847 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e8c46b1820a4ce5ac853ab1cc88fc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98914183afee4e58ad7a425cb019e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:15:51.971739 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-751a7921-c046-4a3f-99fa-d6bce67bd847 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] 10.222.0.13 "GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1" status: 200 len: 1518 microversion: 2.1 time: 0.217881 Jun 07 22:15:51.975395 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 715/1401] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:15:51 2022] GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1 => generated 1518 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:15:52.302024 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-2acf1e4f-7adf-4362-8d22-540adc7385fc tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:52.302628 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-2acf1e4f-7adf-4362-8d22-540adc7385fc tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: 396f0b5c-2d4c-486e-9ab6-b781fc612a4a] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:15:52.305348 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_api:SELECT=71,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:15:52.310191 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-2acf1e4f-7adf-4362-8d22-540adc7385fc tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:52.310633 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-2acf1e4f-7adf-4362-8d22-540adc7385fc tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:52.311641 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-2acf1e4f-7adf-4362-8d22-540adc7385fc tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:52.312324 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-2acf1e4f-7adf-4362-8d22-540adc7385fc tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:52.331386 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.wsgi [None req-2acf1e4f-7adf-4362-8d22-540adc7385fc tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] HTTP exception thrown: Instance 396f0b5c-2d4c-486e-9ab6-b781fc612a4a could not be found. Jun 07 22:15:52.336524 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-2acf1e4f-7adf-4362-8d22-540adc7385fc tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Request method failure captured: Jun 07 22:15:52.336524 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: request: GET /compute/v2.1/servers/396f0b5c-2d4c-486e-9ab6-b781fc612a4a HTTP/1.1 Jun 07 22:15:52.336524 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Accept: application/json Jun 07 22:15:52.336524 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Accept-Encoding: identity Jun 07 22:15:52.336524 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Connection: close Jun 07 22:15:52.336524 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Content-Length: 0 Jun 07 22:15:52.336524 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Content-Type: application/json Jun 07 22:15:52.336524 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Host: 10.222.0.13 Jun 07 22:15:52.336524 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Openstack-System-Scope: None Jun 07 22:15:52.336524 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: User-Agent: python-urllib3/1.26.9 Jun 07 22:15:52.336524 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Auth-Token: gAAAAABin8u7qV85QKMdZKEe68GTjOJU9FFkwnwtG9SoiStsWqE7tDV8Tgx2pD5P95pHCpHANsdmGAnP7iJJpJ0SRM1bjoXdoVBCoXPWcYIXFc_nRMhsmaZLxlygUaCFgJ8n5R4eNEIV6vagbhNNf0OFI7I302r61QvTwj7JImQ0_IwF5QhBUH8 Jun 07 22:15:52.336524 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Domain-Id: None Jun 07 22:15:52.336524 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Domain-Name: None Jun 07 22:15:52.336524 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Identity-Status: Confirmed Jun 07 22:15:52.336524 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Is-Admin-Project: True Jun 07 22:15:52.336524 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Domain-Id: default Jun 07 22:15:52.336524 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Domain-Name: Default Jun 07 22:15:52.336524 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Id: 579eb78d8af74e2cadce3a0c793b4440 Jun 07 22:15:52.336524 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Name: tempest-TestVolumeBootPattern-843087113 Jun 07 22:15:52.336524 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Role: member,reader Jun 07 22:15:52.336524 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Roles: member,reader Jun 07 22:15:52.337998 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/579eb78d8af74e2cadce3a0c793b4440"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_579eb78d8af74e2cadce3a0c793b4440"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/579eb78d8af74e2cadce3a0c793b4440"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/579eb78d8af74e2cadce3a0c793b4440"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}] Jun 07 22:15:52.337998 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Tenant: tempest-TestVolumeBootPattern-843087113 Jun 07 22:15:52.337998 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Tenant-Id: 579eb78d8af74e2cadce3a0c793b4440 Jun 07 22:15:52.337998 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Tenant-Name: tempest-TestVolumeBootPattern-843087113 Jun 07 22:15:52.337998 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User: tempest-TestVolumeBootPattern-843087113-project Jun 07 22:15:52.337998 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Domain-Id: default Jun 07 22:15:52.337998 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Domain-Name: Default Jun 07 22:15:52.337998 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Id: c710942802df49ec8bd630e4b225eed2 Jun 07 22:15:52.337998 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Name: tempest-TestVolumeBootPattern-843087113-project Jun 07 22:15:52.337998 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: method: > Jun 07 22:15:52.337998 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: exception: Instance 396f0b5c-2d4c-486e-9ab6-b781fc612a4a could not be found. Jun 07 22:15:52.337998 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: action_args: {'id': '396f0b5c-2d4c-486e-9ab6-b781fc612a4a'} Jun 07 22:15:52.338812 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 22:15:52.338812 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:15:52.338812 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 22:15:52.338812 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 22:15:52.338812 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 22:15:52.338812 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 22:15:52.338812 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 22:15:52.338812 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 22:15:52.338812 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 22:15:52.338812 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 22:15:52.338812 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 396f0b5c-2d4c-486e-9ab6-b781fc612a4a could not be found. Jun 07 22:15:52.338812 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:15:52.338812 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:15:52.338812 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:15:52.338812 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:15:52.338812 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:15:52.338812 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:15:52.338812 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 22:15:52.338812 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 22:15:52.338812 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 22:15:52.340212 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 22:15:52.340212 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 22:15:52.340212 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 22:15:52.340212 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 22:15:52.340212 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 22:15:52.340212 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 22:15:52.340212 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 22:15:52.340212 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 396f0b5c-2d4c-486e-9ab6-b781fc612a4a could not be found. Jun 07 22:15:52.340212 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:15:52.340212 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:15:52.340212 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:15:52.340212 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:15:52.340212 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:15:52.340212 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:15:52.340212 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 22:15:52.340212 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 22:15:52.340212 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 396f0b5c-2d4c-486e-9ab6-b781fc612a4a could not be found. Jun 07 22:15:52.340212 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:15:52.342403 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-2acf1e4f-7adf-4362-8d22-540adc7385fc tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Returning 404 to user: Instance 396f0b5c-2d4c-486e-9ab6-b781fc612a4a could not be found. {{(pid=117970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 22:15:52.342403 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-2acf1e4f-7adf-4362-8d22-540adc7385fc tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/396f0b5c-2d4c-486e-9ab6-b781fc612a4a" status: 404 len: 111 microversion: 2.1 time: 0.036881 Jun 07 22:15:52.342403 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 687/1402] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:15:52 2022] GET /compute/v2.1/servers/396f0b5c-2d4c-486e-9ab6-b781fc612a4a => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 22:15:52.858175 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [req-03b062d2-7a84-425c-a207-887621961cdd req-9e603d3c-d8d1-4afe-ade9-ef349543889d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d8ab38f-db6d-4560-962e-c1e55c509ce1", "name": "network-vif-unplugged", "status": "completed", "tag": "c6cae0af-2220-44aa-8bba-70f301632681"}]} {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:15:52.867197 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:15:52.869985 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-03b062d2-7a84-425c-a207-887621961cdd req-9e603d3c-d8d1-4afe-ade9-ef349543889d service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:52.870679 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-03b062d2-7a84-425c-a207-887621961cdd req-9e603d3c-d8d1-4afe-ade9-ef349543889d service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:52.887442 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.compute.server_external_events [req-03b062d2-7a84-425c-a207-887621961cdd req-9e603d3c-d8d1-4afe-ade9-ef349543889d service nova] Unable to find a host for instance 4d8ab38f-db6d-4560-962e-c1e55c509ce1. Dropping event network-vif-unplugged {{(pid=117971) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 07 22:15:52.888691 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [req-03b062d2-7a84-425c-a207-887621961cdd req-9e603d3c-d8d1-4afe-ade9-ef349543889d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.035934 Jun 07 22:15:52.889880 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 716/1403] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:15:52 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 37 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 07 22:15:52.990697 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-b9415f12-1d85-4074-80f8-d832246cd2a5 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:52.991360 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-b9415f12-1d85-4074-80f8-d832246cd2a5 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] [instance: 4d8ab38f-db6d-4560-962e-c1e55c509ce1] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:15:52.998508 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-b9415f12-1d85-4074-80f8-d832246cd2a5 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:52.998963 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-b9415f12-1d85-4074-80f8-d832246cd2a5 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:52.999837 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-b9415f12-1d85-4074-80f8-d832246cd2a5 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:53.000277 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-b9415f12-1d85-4074-80f8-d832246cd2a5 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:53.154714 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-b9415f12-1d85-4074-80f8-d832246cd2a5 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e8c46b1820a4ce5ac853ab1cc88fc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98914183afee4e58ad7a425cb019e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:15:53.164660 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-b9415f12-1d85-4074-80f8-d832246cd2a5 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] 10.222.0.13 "GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1" status: 200 len: 1520 microversion: 2.1 time: 0.178192 Jun 07 22:15:53.165310 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 688/1404] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:15:52 2022] GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1 => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:15:54.182164 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-16aa9148-cb2a-430b-8074-8c0c9ca5d3c2 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:54.182766 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-16aa9148-cb2a-430b-8074-8c0c9ca5d3c2 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] [instance: 4d8ab38f-db6d-4560-962e-c1e55c509ce1] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:15:54.189411 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-16aa9148-cb2a-430b-8074-8c0c9ca5d3c2 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:54.189850 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-16aa9148-cb2a-430b-8074-8c0c9ca5d3c2 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:54.190598 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-16aa9148-cb2a-430b-8074-8c0c9ca5d3c2 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:54.191035 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-16aa9148-cb2a-430b-8074-8c0c9ca5d3c2 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:54.241537 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-5ccb65b4-d46f-4113-81fa-381dee03ab48 tempest-VolumesTestJSON-442851167 tempest-VolumesTestJSON-442851167-project] Calling method '.version_select at 0x7f92f0f91820>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:54.294863 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-5ccb65b4-d46f-4113-81fa-381dee03ab48 tempest-VolumesTestJSON-442851167 tempest-VolumesTestJSON-442851167-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/9b1afbee-e324-40a2-b1bc-d233b50586cd" status: 200 len: 350 microversion: 2.1 time: 0.056896 Jun 07 22:15:54.295887 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 689/1405] 10.222.0.13 () {58 vars in 1244 bytes} [Tue Jun 7 22:15:54 2022] GET /compute/v2.1/os-volumes/9b1afbee-e324-40a2-b1bc-d233b50586cd => generated 350 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 22:15:54.330537 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-16aa9148-cb2a-430b-8074-8c0c9ca5d3c2 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e8c46b1820a4ce5ac853ab1cc88fc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98914183afee4e58ad7a425cb019e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:15:54.338928 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-16aa9148-cb2a-430b-8074-8c0c9ca5d3c2 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] 10.222.0.13 "GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1" status: 200 len: 1520 microversion: 2.1 time: 0.160588 Jun 07 22:15:54.339522 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 717/1406] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:15:54 2022] GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:15:55.357213 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-f667f642-161b-4ee5-8eb6-47859c909abc tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:55.358665 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-f667f642-161b-4ee5-8eb6-47859c909abc tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] [instance: 4d8ab38f-db6d-4560-962e-c1e55c509ce1] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:15:55.366389 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f667f642-161b-4ee5-8eb6-47859c909abc tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:55.366840 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f667f642-161b-4ee5-8eb6-47859c909abc tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:55.367651 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f667f642-161b-4ee5-8eb6-47859c909abc tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:55.368457 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f667f642-161b-4ee5-8eb6-47859c909abc tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:55.388776 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:15:55.592085 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-f667f642-161b-4ee5-8eb6-47859c909abc tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e8c46b1820a4ce5ac853ab1cc88fc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98914183afee4e58ad7a425cb019e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:15:55.604927 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-f667f642-161b-4ee5-8eb6-47859c909abc tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] 10.222.0.13 "GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1" status: 200 len: 1576 microversion: 2.1 time: 0.252460 Jun 07 22:15:55.606196 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 690/1407] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:15:55 2022] GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1 => generated 1576 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:15:55.634842 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-8ddb8151-bb02-4f49-b995-7e483f085d08 tempest-VolumesTestJSON-442851167 tempest-VolumesTestJSON-442851167-project] Calling method '.version_select at 0x7f92f66cc700>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:55.686507 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-8ddb8151-bb02-4f49-b995-7e483f085d08 tempest-VolumesTestJSON-442851167 tempest-VolumesTestJSON-442851167-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/73787002-aca9-4d3d-9111-7ce6e865d3f6" status: 200 len: 350 microversion: 2.1 time: 0.055457 Jun 07 22:15:55.687075 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 718/1408] 10.222.0.13 () {58 vars in 1244 bytes} [Tue Jun 7 22:15:55 2022] GET /compute/v2.1/os-volumes/73787002-aca9-4d3d-9111-7ce6e865d3f6 => generated 350 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 22:15:55.804975 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-ea79cecb-4f89-4042-b03b-c97452e2266e tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:55.805812 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-ea79cecb-4f89-4042-b03b-c97452e2266e tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: 454d121a-d51a-4a5e-9c68-6280d2c6a1b2] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:15:55.810776 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [req-92cf3d15-2d7a-4959-8171-af31bb8a0409 req-610cd01d-b4e4-4261-8e53-5be6d72d5c30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "454d121a-d51a-4a5e-9c68-6280d2c6a1b2", "tag": "578443e3-4c7f-498f-897f-5639fda8f902"}]} {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:15:55.812797 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-ea79cecb-4f89-4042-b03b-c97452e2266e tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:55.814026 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-ea79cecb-4f89-4042-b03b-c97452e2266e tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:55.815999 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-ea79cecb-4f89-4042-b03b-c97452e2266e tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:55.817145 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-ea79cecb-4f89-4042-b03b-c97452e2266e tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:55.828232 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-92cf3d15-2d7a-4959-8171-af31bb8a0409 req-610cd01d-b4e4-4261-8e53-5be6d72d5c30 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:55.828869 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-92cf3d15-2d7a-4959-8171-af31bb8a0409 req-610cd01d-b4e4-4261-8e53-5be6d72d5c30 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:55.845630 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.compute.server_external_events [req-92cf3d15-2d7a-4959-8171-af31bb8a0409 req-610cd01d-b4e4-4261-8e53-5be6d72d5c30 service nova] Creating event network-changed:578443e3-4c7f-498f-897f-5639fda8f902 for instance 454d121a-d51a-4a5e-9c68-6280d2c6a1b2 on hv-cinder-83552 Jun 07 22:15:55.846820 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-ea79cecb-4f89-4042-b03b-c97452e2266e tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: 454d121a-d51a-4a5e-9c68-6280d2c6a1b2] Going to try to terminate instance {{(pid=117970) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 22:15:55.854422 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [req-92cf3d15-2d7a-4959-8171-af31bb8a0409 req-610cd01d-b4e4-4261-8e53-5be6d72d5c30 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048135 Jun 07 22:15:55.860862 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 719/1409] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:15:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:15:55.937704 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-ea79cecb-4f89-4042-b03b-c97452e2266e tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "DELETE /compute/v2.1/servers/454d121a-d51a-4a5e-9c68-6280d2c6a1b2" status: 204 len: 0 microversion: 2.1 time: 0.136762 Jun 07 22:15:55.945702 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 691/1410] 10.222.0.13 () {58 vars in 1238 bytes} [Tue Jun 7 22:15:55 2022] DELETE /compute/v2.1/servers/454d121a-d51a-4a5e-9c68-6280d2c6a1b2 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 22:15:55.951753 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-4941ebff-6539-45c9-8727-4da2835f5a2d tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:55.952705 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-4941ebff-6539-45c9-8727-4da2835f5a2d tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: 454d121a-d51a-4a5e-9c68-6280d2c6a1b2] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:15:55.960725 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-4941ebff-6539-45c9-8727-4da2835f5a2d tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:55.961277 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-4941ebff-6539-45c9-8727-4da2835f5a2d tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:55.961917 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-4941ebff-6539-45c9-8727-4da2835f5a2d tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:55.962581 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-4941ebff-6539-45c9-8727-4da2835f5a2d tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:56.106391 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-4941ebff-6539-45c9-8727-4da2835f5a2d tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:15:56.114798 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-4941ebff-6539-45c9-8727-4da2835f5a2d tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/454d121a-d51a-4a5e-9c68-6280d2c6a1b2" status: 200 len: 1578 microversion: 2.1 time: 0.168495 Jun 07 22:15:56.115382 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 720/1411] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:15:55 2022] GET /compute/v2.1/servers/454d121a-d51a-4a5e-9c68-6280d2c6a1b2 => generated 1578 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:15:56.624333 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-a62c4ea7-76b7-4d63-9a80-475d613b5f6d tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:56.625240 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-a62c4ea7-76b7-4d63-9a80-475d613b5f6d tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] [instance: 4d8ab38f-db6d-4560-962e-c1e55c509ce1] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:15:56.632030 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a62c4ea7-76b7-4d63-9a80-475d613b5f6d tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:56.632471 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a62c4ea7-76b7-4d63-9a80-475d613b5f6d tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:56.633224 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a62c4ea7-76b7-4d63-9a80-475d613b5f6d tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:56.633651 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-a62c4ea7-76b7-4d63-9a80-475d613b5f6d tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:56.784710 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-a62c4ea7-76b7-4d63-9a80-475d613b5f6d tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e8c46b1820a4ce5ac853ab1cc88fc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98914183afee4e58ad7a425cb019e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:15:56.793648 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-a62c4ea7-76b7-4d63-9a80-475d613b5f6d tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] 10.222.0.13 "GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1" status: 200 len: 1576 microversion: 2.1 time: 0.173654 Jun 07 22:15:56.794560 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 692/1412] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:15:56 2022] GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1 => generated 1576 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:15:57.076452 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-ff1ef0ee-da3f-4ac5-a396-2e6423956bed tempest-VolumesTestJSON-442851167 tempest-VolumesTestJSON-442851167-project] Calling method '.version_select at 0x7f92f66cc700>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:57.123140 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-ff1ef0ee-da3f-4ac5-a396-2e6423956bed tempest-VolumesTestJSON-442851167 tempest-VolumesTestJSON-442851167-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/9b4781fb-3cb4-47aa-962e-3a7f16889b91" status: 200 len: 351 microversion: 2.1 time: 0.050618 Jun 07 22:15:57.123766 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 721/1413] 10.222.0.13 () {58 vars in 1244 bytes} [Tue Jun 7 22:15:57 2022] GET /compute/v2.1/os-volumes/9b4781fb-3cb4-47aa-962e-3a7f16889b91 => generated 351 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:15:57.132808 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-9b00bc29-bd88-47c9-8300-bb7522d191f4 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:57.133411 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-9b00bc29-bd88-47c9-8300-bb7522d191f4 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: 454d121a-d51a-4a5e-9c68-6280d2c6a1b2] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:15:57.134349 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-d8cd15a2-577b-41ad-b222-9a598056f145 tempest-VolumesTestJSON-442851167 tempest-VolumesTestJSON-442851167-project] Calling method '.version_select at 0x7f92f671ad30>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:57.139305 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-9b00bc29-bd88-47c9-8300-bb7522d191f4 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:57.139838 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-9b00bc29-bd88-47c9-8300-bb7522d191f4 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:57.140582 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-9b00bc29-bd88-47c9-8300-bb7522d191f4 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:57.141010 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-9b00bc29-bd88-47c9-8300-bb7522d191f4 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:57.217967 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-d8cd15a2-577b-41ad-b222-9a598056f145 tempest-VolumesTestJSON-442851167 tempest-VolumesTestJSON-442851167-project] 10.222.0.13 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.087125 Jun 07 22:15:57.219194 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 722/1414] 10.222.0.13 () {58 vars in 1133 bytes} [Tue Jun 7 22:15:57 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 22:15:57.231529 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-fe15f894-4b66-4e26-a12d-faec48d5d431 tempest-VolumesTestJSON-442851167 tempest-VolumesTestJSON-442851167-project] Calling method '.version_select at 0x7f92f13ce790>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:57.291649 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-9b00bc29-bd88-47c9-8300-bb7522d191f4 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:15:57.299224 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-9b00bc29-bd88-47c9-8300-bb7522d191f4 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/454d121a-d51a-4a5e-9c68-6280d2c6a1b2" status: 200 len: 1578 microversion: 2.1 time: 0.170632 Jun 07 22:15:57.299754 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 693/1415] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:15:57 2022] GET /compute/v2.1/servers/454d121a-d51a-4a5e-9c68-6280d2c6a1b2 => generated 1578 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:15:57.315968 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-fe15f894-4b66-4e26-a12d-faec48d5d431 tempest-VolumesTestJSON-442851167 tempest-VolumesTestJSON-442851167-project] 10.222.0.13 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.088353 Jun 07 22:15:57.317053 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 723/1416] 10.222.0.13 () {58 vars in 1148 bytes} [Tue Jun 7 22:15:57 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 22:15:57.328442 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-11400c7b-a8b4-41b3-be4e-919d55fc8e34 tempest-VolumesTestJSON-442851167 tempest-VolumesTestJSON-442851167-project] Calling method '.version_select at 0x7f92f0f91160>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:57.416263 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-11400c7b-a8b4-41b3-be4e-919d55fc8e34 tempest-VolumesTestJSON-442851167 tempest-VolumesTestJSON-442851167-project] 10.222.0.13 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.091367 Jun 07 22:15:57.416847 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 694/1417] 10.222.0.13 () {58 vars in 1133 bytes} [Tue Jun 7 22:15:57 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:15:57.429207 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-84db69f4-05d8-41d7-8330-aee08ad756d6 tempest-VolumesTestJSON-442851167 tempest-VolumesTestJSON-442851167-project] Calling method '.version_select at 0x7f92f142e0d0>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:57.509473 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-84db69f4-05d8-41d7-8330-aee08ad756d6 tempest-VolumesTestJSON-442851167 tempest-VolumesTestJSON-442851167-project] 10.222.0.13 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.084652 Jun 07 22:15:57.510166 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 724/1418] 10.222.0.13 () {58 vars in 1166 bytes} [Tue Jun 7 22:15:57 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:15:57.521770 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-b4e0e189-fdd5-4a26-a79a-08c372c510ad tempest-VolumesTestJSON-442851167 tempest-VolumesTestJSON-442851167-project] Calling method '.version_select at 0x7f92f100ee50>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:57.609539 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-b4e0e189-fdd5-4a26-a79a-08c372c510ad tempest-VolumesTestJSON-442851167 tempest-VolumesTestJSON-442851167-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.091605 Jun 07 22:15:57.610209 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 695/1419] 10.222.0.13 () {58 vars in 1169 bytes} [Tue Jun 7 22:15:57 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:15:57.625438 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-c8c9b3ae-eda8-4187-80e9-3d6f47793346 tempest-VolumesTestJSON-442851167 tempest-VolumesTestJSON-442851167-project] Calling method '.version_select at 0x7f92f671aca0>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:57.705382 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-c8c9b3ae-eda8-4187-80e9-3d6f47793346 tempest-VolumesTestJSON-442851167 tempest-VolumesTestJSON-442851167-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.083921 Jun 07 22:15:57.705964 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 725/1420] 10.222.0.13 () {58 vars in 1154 bytes} [Tue Jun 7 22:15:57 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:15:57.718049 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-5d93b563-0328-4735-a9b5-baaa6e21fa3f tempest-VolumesTestJSON-442851167 tempest-VolumesTestJSON-442851167-project] Calling method '.version_select at 0x7f92f0fb2820>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:57.802440 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-5d93b563-0328-4735-a9b5-baaa6e21fa3f tempest-VolumesTestJSON-442851167 tempest-VolumesTestJSON-442851167-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.088809 Jun 07 22:15:57.803007 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 696/1421] 10.222.0.13 () {58 vars in 1187 bytes} [Tue Jun 7 22:15:57 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:15:57.814789 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-ab433f40-bf7e-4113-a4c9-a4525aa834a8 tempest-VolumesTestJSON-442851167 tempest-VolumesTestJSON-442851167-project] Calling method '.version_select at 0x7f92f66cc700>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:57.825796 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-3a21849d-0e22-4041-beae-4df84f1e7fc4 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:57.826402 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-3a21849d-0e22-4041-beae-4df84f1e7fc4 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] [instance: 4d8ab38f-db6d-4560-962e-c1e55c509ce1] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:15:57.833323 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-3a21849d-0e22-4041-beae-4df84f1e7fc4 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:57.833765 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-3a21849d-0e22-4041-beae-4df84f1e7fc4 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:57.834520 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-3a21849d-0e22-4041-beae-4df84f1e7fc4 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:57.835138 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-3a21849d-0e22-4041-beae-4df84f1e7fc4 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:57.908566 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-ab433f40-bf7e-4113-a4c9-a4525aa834a8 tempest-VolumesTestJSON-442851167 tempest-VolumesTestJSON-442851167-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.097561 Jun 07 22:15:57.920353 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 726/1422] 10.222.0.13 () {58 vars in 1154 bytes} [Tue Jun 7 22:15:57 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:15:58.042513 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-3a21849d-0e22-4041-beae-4df84f1e7fc4 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e8c46b1820a4ce5ac853ab1cc88fc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98914183afee4e58ad7a425cb019e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:15:58.050412 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-3a21849d-0e22-4041-beae-4df84f1e7fc4 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] 10.222.0.13 "GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1" status: 200 len: 1576 microversion: 2.1 time: 0.229946 Jun 07 22:15:58.051746 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 697/1423] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:15:57 2022] GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1 => generated 1576 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:15:58.093179 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [req-0ee609c7-3070-4ebb-9a18-9d3bd5df1273 req-c46947b2-b0fd-4205-8431-c6bef55dfa98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "454d121a-d51a-4a5e-9c68-6280d2c6a1b2", "name": "network-vif-deleted", "tag": "578443e3-4c7f-498f-897f-5639fda8f902"}]} {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:15:58.102281 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-0ee609c7-3070-4ebb-9a18-9d3bd5df1273 req-c46947b2-b0fd-4205-8431-c6bef55dfa98 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:58.102727 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-0ee609c7-3070-4ebb-9a18-9d3bd5df1273 req-c46947b2-b0fd-4205-8431-c6bef55dfa98 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:58.114520 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.compute.server_external_events [req-0ee609c7-3070-4ebb-9a18-9d3bd5df1273 req-c46947b2-b0fd-4205-8431-c6bef55dfa98 service nova] Creating event network-vif-deleted:578443e3-4c7f-498f-897f-5639fda8f902 for instance 454d121a-d51a-4a5e-9c68-6280d2c6a1b2 on hv-cinder-83552 Jun 07 22:15:58.119374 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [req-0ee609c7-3070-4ebb-9a18-9d3bd5df1273 req-c46947b2-b0fd-4205-8431-c6bef55dfa98 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030621 Jun 07 22:15:58.120052 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 727/1424] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:15:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 22:15:58.315935 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-7c6f7aed-a24f-4975-8ac6-f567b4d61fab tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:58.316486 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-7c6f7aed-a24f-4975-8ac6-f567b4d61fab tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: 454d121a-d51a-4a5e-9c68-6280d2c6a1b2] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:15:58.322500 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-7c6f7aed-a24f-4975-8ac6-f567b4d61fab tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:58.322947 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-7c6f7aed-a24f-4975-8ac6-f567b4d61fab tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:58.323732 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-7c6f7aed-a24f-4975-8ac6-f567b4d61fab tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:58.324218 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-7c6f7aed-a24f-4975-8ac6-f567b4d61fab tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:58.387872 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-7c6f7aed-a24f-4975-8ac6-f567b4d61fab tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710942802df49ec8bd630e4b225eed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '579eb78d8af74e2cadce3a0c793b4440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:15:58.398239 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-7c6f7aed-a24f-4975-8ac6-f567b4d61fab tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/454d121a-d51a-4a5e-9c68-6280d2c6a1b2" status: 200 len: 1225 microversion: 2.1 time: 0.086142 Jun 07 22:15:58.400779 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 698/1425] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:15:58 2022] GET /compute/v2.1/servers/454d121a-d51a-4a5e-9c68-6280d2c6a1b2 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:15:59.069223 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-6aa2fc23-64b5-4ce2-8084-58dd84d58ff9 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:59.069909 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-6aa2fc23-64b5-4ce2-8084-58dd84d58ff9 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] [instance: 4d8ab38f-db6d-4560-962e-c1e55c509ce1] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:15:59.076021 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-6aa2fc23-64b5-4ce2-8084-58dd84d58ff9 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:59.076475 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-6aa2fc23-64b5-4ce2-8084-58dd84d58ff9 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:59.077802 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-6aa2fc23-64b5-4ce2-8084-58dd84d58ff9 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:59.078237 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-6aa2fc23-64b5-4ce2-8084-58dd84d58ff9 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:59.216372 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-6aa2fc23-64b5-4ce2-8084-58dd84d58ff9 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e8c46b1820a4ce5ac853ab1cc88fc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98914183afee4e58ad7a425cb019e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:15:59.223861 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-6aa2fc23-64b5-4ce2-8084-58dd84d58ff9 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] 10.222.0.13 "GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1" status: 200 len: 1576 microversion: 2.1 time: 0.159386 Jun 07 22:15:59.224426 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 728/1426] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:15:59 2022] GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1 => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:15:59.416157 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-ccccd7fe-e89b-4d3c-8927-a0d5010d746e tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:59.416763 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-ccccd7fe-e89b-4d3c-8927-a0d5010d746e tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: 454d121a-d51a-4a5e-9c68-6280d2c6a1b2] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:15:59.423105 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-ccccd7fe-e89b-4d3c-8927-a0d5010d746e tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:59.423591 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-ccccd7fe-e89b-4d3c-8927-a0d5010d746e tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:59.424333 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-ccccd7fe-e89b-4d3c-8927-a0d5010d746e tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:59.424761 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-ccccd7fe-e89b-4d3c-8927-a0d5010d746e tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:59.439365 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.wsgi [None req-ccccd7fe-e89b-4d3c-8927-a0d5010d746e tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] HTTP exception thrown: Instance 454d121a-d51a-4a5e-9c68-6280d2c6a1b2 could not be found. Jun 07 22:15:59.441030 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-ccccd7fe-e89b-4d3c-8927-a0d5010d746e tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Request method failure captured: Jun 07 22:15:59.441030 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: request: GET /compute/v2.1/servers/454d121a-d51a-4a5e-9c68-6280d2c6a1b2 HTTP/1.1 Jun 07 22:15:59.441030 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Accept: application/json Jun 07 22:15:59.441030 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Accept-Encoding: identity Jun 07 22:15:59.441030 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Connection: close Jun 07 22:15:59.441030 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Content-Length: 0 Jun 07 22:15:59.441030 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Content-Type: application/json Jun 07 22:15:59.441030 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Host: 10.222.0.13 Jun 07 22:15:59.441030 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Openstack-System-Scope: None Jun 07 22:15:59.441030 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: User-Agent: python-urllib3/1.26.9 Jun 07 22:15:59.441030 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Auth-Token: gAAAAABin8u7qV85QKMdZKEe68GTjOJU9FFkwnwtG9SoiStsWqE7tDV8Tgx2pD5P95pHCpHANsdmGAnP7iJJpJ0SRM1bjoXdoVBCoXPWcYIXFc_nRMhsmaZLxlygUaCFgJ8n5R4eNEIV6vagbhNNf0OFI7I302r61QvTwj7JImQ0_IwF5QhBUH8 Jun 07 22:15:59.441030 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Domain-Id: None Jun 07 22:15:59.441030 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Domain-Name: None Jun 07 22:15:59.441030 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Identity-Status: Confirmed Jun 07 22:15:59.441030 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Is-Admin-Project: True Jun 07 22:15:59.441030 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Domain-Id: default Jun 07 22:15:59.441030 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Domain-Name: Default Jun 07 22:15:59.441030 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Id: 579eb78d8af74e2cadce3a0c793b4440 Jun 07 22:15:59.441030 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Name: tempest-TestVolumeBootPattern-843087113 Jun 07 22:15:59.441030 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Role: member,reader Jun 07 22:15:59.441030 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Roles: member,reader Jun 07 22:15:59.443719 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/579eb78d8af74e2cadce3a0c793b4440"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_579eb78d8af74e2cadce3a0c793b4440"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/579eb78d8af74e2cadce3a0c793b4440"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/579eb78d8af74e2cadce3a0c793b4440"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}] Jun 07 22:15:59.443719 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Tenant: tempest-TestVolumeBootPattern-843087113 Jun 07 22:15:59.443719 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Tenant-Id: 579eb78d8af74e2cadce3a0c793b4440 Jun 07 22:15:59.443719 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Tenant-Name: tempest-TestVolumeBootPattern-843087113 Jun 07 22:15:59.443719 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User: tempest-TestVolumeBootPattern-843087113-project Jun 07 22:15:59.443719 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Domain-Id: default Jun 07 22:15:59.443719 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Domain-Name: Default Jun 07 22:15:59.443719 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Id: c710942802df49ec8bd630e4b225eed2 Jun 07 22:15:59.443719 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Name: tempest-TestVolumeBootPattern-843087113-project Jun 07 22:15:59.443719 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: method: > Jun 07 22:15:59.443719 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: exception: Instance 454d121a-d51a-4a5e-9c68-6280d2c6a1b2 could not be found. Jun 07 22:15:59.443719 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: action_args: {'id': '454d121a-d51a-4a5e-9c68-6280d2c6a1b2'} Jun 07 22:15:59.445122 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 22:15:59.445122 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:15:59.445122 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 22:15:59.445122 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 22:15:59.445122 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 22:15:59.445122 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 22:15:59.445122 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 22:15:59.445122 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 22:15:59.445122 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 22:15:59.445122 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 22:15:59.445122 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 454d121a-d51a-4a5e-9c68-6280d2c6a1b2 could not be found. Jun 07 22:15:59.445122 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:15:59.445122 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:15:59.445122 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:15:59.445122 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:15:59.445122 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:15:59.445122 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:15:59.445122 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 22:15:59.445122 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 22:15:59.445122 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 22:15:59.446674 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 22:15:59.446674 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 22:15:59.446674 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 22:15:59.446674 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 22:15:59.446674 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 22:15:59.446674 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 22:15:59.446674 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 22:15:59.446674 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 454d121a-d51a-4a5e-9c68-6280d2c6a1b2 could not be found. Jun 07 22:15:59.446674 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:15:59.446674 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:15:59.446674 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:15:59.446674 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:15:59.446674 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:15:59.446674 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:15:59.446674 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 22:15:59.446674 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 22:15:59.446674 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 454d121a-d51a-4a5e-9c68-6280d2c6a1b2 could not be found. Jun 07 22:15:59.446674 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:15:59.448131 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-ccccd7fe-e89b-4d3c-8927-a0d5010d746e tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Returning 404 to user: Instance 454d121a-d51a-4a5e-9c68-6280d2c6a1b2 could not be found. {{(pid=117970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 22:15:59.448131 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-ccccd7fe-e89b-4d3c-8927-a0d5010d746e tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/454d121a-d51a-4a5e-9c68-6280d2c6a1b2" status: 404 len: 111 microversion: 2.1 time: 0.031134 Jun 07 22:15:59.448131 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 699/1427] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:15:59 2022] GET /compute/v2.1/servers/454d121a-d51a-4a5e-9c68-6280d2c6a1b2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 22:15:59.883304 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-cbea43bb-fdff-44c7-8275-e523b966d405 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:59.883825 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-cbea43bb-fdff-44c7-8275-e523b966d405 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: c2ece8dd-91fb-472c-b0c7-970ee215412f] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:15:59.889934 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-cbea43bb-fdff-44c7-8275-e523b966d405 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:59.890376 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-cbea43bb-fdff-44c7-8275-e523b966d405 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:59.891163 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-cbea43bb-fdff-44c7-8275-e523b966d405 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:59.891624 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-cbea43bb-fdff-44c7-8275-e523b966d405 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:59.905401 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.wsgi [None req-cbea43bb-fdff-44c7-8275-e523b966d405 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] HTTP exception thrown: Instance c2ece8dd-91fb-472c-b0c7-970ee215412f could not be found. Jun 07 22:15:59.907036 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-cbea43bb-fdff-44c7-8275-e523b966d405 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Request method failure captured: Jun 07 22:15:59.907036 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: request: DELETE /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f HTTP/1.1 Jun 07 22:15:59.907036 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Accept: application/json Jun 07 22:15:59.907036 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Accept-Encoding: identity Jun 07 22:15:59.907036 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Connection: close Jun 07 22:15:59.907036 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Content-Length: 0 Jun 07 22:15:59.907036 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Content-Type: application/json Jun 07 22:15:59.907036 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Host: 10.222.0.13 Jun 07 22:15:59.907036 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Openstack-System-Scope: None Jun 07 22:15:59.907036 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: User-Agent: python-urllib3/1.26.9 Jun 07 22:15:59.907036 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Auth-Token: gAAAAABin8u7qV85QKMdZKEe68GTjOJU9FFkwnwtG9SoiStsWqE7tDV8Tgx2pD5P95pHCpHANsdmGAnP7iJJpJ0SRM1bjoXdoVBCoXPWcYIXFc_nRMhsmaZLxlygUaCFgJ8n5R4eNEIV6vagbhNNf0OFI7I302r61QvTwj7JImQ0_IwF5QhBUH8 Jun 07 22:15:59.907036 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Domain-Id: None Jun 07 22:15:59.907036 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Domain-Name: None Jun 07 22:15:59.907036 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Identity-Status: Confirmed Jun 07 22:15:59.907036 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Is-Admin-Project: True Jun 07 22:15:59.907036 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Domain-Id: default Jun 07 22:15:59.907036 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Domain-Name: Default Jun 07 22:15:59.907036 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Id: 579eb78d8af74e2cadce3a0c793b4440 Jun 07 22:15:59.907036 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Name: tempest-TestVolumeBootPattern-843087113 Jun 07 22:15:59.907036 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Role: member,reader Jun 07 22:15:59.907036 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Roles: member,reader Jun 07 22:15:59.908696 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/579eb78d8af74e2cadce3a0c793b4440"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_579eb78d8af74e2cadce3a0c793b4440"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/579eb78d8af74e2cadce3a0c793b4440"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/579eb78d8af74e2cadce3a0c793b4440"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}] Jun 07 22:15:59.908696 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant: tempest-TestVolumeBootPattern-843087113 Jun 07 22:15:59.908696 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant-Id: 579eb78d8af74e2cadce3a0c793b4440 Jun 07 22:15:59.908696 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant-Name: tempest-TestVolumeBootPattern-843087113 Jun 07 22:15:59.908696 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User: tempest-TestVolumeBootPattern-843087113-project Jun 07 22:15:59.908696 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Domain-Id: default Jun 07 22:15:59.908696 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Domain-Name: Default Jun 07 22:15:59.908696 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Id: c710942802df49ec8bd630e4b225eed2 Jun 07 22:15:59.908696 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Name: tempest-TestVolumeBootPattern-843087113-project Jun 07 22:15:59.908696 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: method: > Jun 07 22:15:59.908696 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: exception: Instance c2ece8dd-91fb-472c-b0c7-970ee215412f could not be found. Jun 07 22:15:59.908696 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: action_args: {'id': 'c2ece8dd-91fb-472c-b0c7-970ee215412f'} Jun 07 22:15:59.909551 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 22:15:59.909551 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:15:59.909551 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 22:15:59.909551 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 22:15:59.909551 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 22:15:59.909551 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 22:15:59.909551 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 22:15:59.909551 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 22:15:59.909551 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 22:15:59.909551 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 22:15:59.909551 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2ece8dd-91fb-472c-b0c7-970ee215412f could not be found. Jun 07 22:15:59.909551 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:15:59.909551 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:15:59.909551 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:15:59.909551 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:15:59.909551 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:15:59.909551 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:15:59.909551 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 22:15:59.909551 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 22:15:59.909551 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 22:15:59.911028 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 22:15:59.911028 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 22:15:59.911028 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 22:15:59.911028 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 22:15:59.911028 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 22:15:59.911028 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 22:15:59.911028 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 22:15:59.911028 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 22:15:59.911028 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 22:15:59.911028 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2ece8dd-91fb-472c-b0c7-970ee215412f could not be found. Jun 07 22:15:59.911028 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:15:59.911028 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:15:59.911028 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:15:59.911028 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:15:59.911028 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:15:59.911028 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:15:59.911028 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 22:15:59.911028 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 22:15:59.911028 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2ece8dd-91fb-472c-b0c7-970ee215412f could not be found. Jun 07 22:15:59.911028 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:15:59.913227 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-cbea43bb-fdff-44c7-8275-e523b966d405 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Returning 404 to user: Instance c2ece8dd-91fb-472c-b0c7-970ee215412f could not be found. {{(pid=117971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 22:15:59.913227 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-cbea43bb-fdff-44c7-8275-e523b966d405 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "DELETE /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f" status: 404 len: 111 microversion: 2.1 time: 0.029382 Jun 07 22:15:59.913227 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 729/1428] 10.222.0.13 () {58 vars in 1238 bytes} [Tue Jun 7 22:15:59 2022] DELETE /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 22:15:59.917925 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-c55d5980-4c19-474d-8dd1-3d4cf31b1ca7 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:15:59.918525 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-c55d5980-4c19-474d-8dd1-3d4cf31b1ca7 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] [instance: c2ece8dd-91fb-472c-b0c7-970ee215412f] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:15:59.924437 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c55d5980-4c19-474d-8dd1-3d4cf31b1ca7 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:59.924877 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c55d5980-4c19-474d-8dd1-3d4cf31b1ca7 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:59.925615 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c55d5980-4c19-474d-8dd1-3d4cf31b1ca7 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:15:59.926102 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-c55d5980-4c19-474d-8dd1-3d4cf31b1ca7 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:15:59.939389 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.wsgi [None req-c55d5980-4c19-474d-8dd1-3d4cf31b1ca7 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] HTTP exception thrown: Instance c2ece8dd-91fb-472c-b0c7-970ee215412f could not be found. Jun 07 22:15:59.940879 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-c55d5980-4c19-474d-8dd1-3d4cf31b1ca7 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Request method failure captured: Jun 07 22:15:59.940879 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: request: GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f HTTP/1.1 Jun 07 22:15:59.940879 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Accept: application/json Jun 07 22:15:59.940879 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Accept-Encoding: identity Jun 07 22:15:59.940879 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Connection: close Jun 07 22:15:59.940879 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Content-Length: 0 Jun 07 22:15:59.940879 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Content-Type: application/json Jun 07 22:15:59.940879 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Host: 10.222.0.13 Jun 07 22:15:59.940879 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Openstack-System-Scope: None Jun 07 22:15:59.940879 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: User-Agent: python-urllib3/1.26.9 Jun 07 22:15:59.940879 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Auth-Token: gAAAAABin8u7qV85QKMdZKEe68GTjOJU9FFkwnwtG9SoiStsWqE7tDV8Tgx2pD5P95pHCpHANsdmGAnP7iJJpJ0SRM1bjoXdoVBCoXPWcYIXFc_nRMhsmaZLxlygUaCFgJ8n5R4eNEIV6vagbhNNf0OFI7I302r61QvTwj7JImQ0_IwF5QhBUH8 Jun 07 22:15:59.940879 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Domain-Id: None Jun 07 22:15:59.940879 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Domain-Name: None Jun 07 22:15:59.940879 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Identity-Status: Confirmed Jun 07 22:15:59.940879 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Is-Admin-Project: True Jun 07 22:15:59.940879 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Domain-Id: default Jun 07 22:15:59.940879 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Domain-Name: Default Jun 07 22:15:59.940879 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Id: 579eb78d8af74e2cadce3a0c793b4440 Jun 07 22:15:59.940879 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Project-Name: tempest-TestVolumeBootPattern-843087113 Jun 07 22:15:59.940879 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Role: member,reader Jun 07 22:15:59.940879 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Roles: member,reader Jun 07 22:15:59.942642 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/579eb78d8af74e2cadce3a0c793b4440"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_579eb78d8af74e2cadce3a0c793b4440"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/579eb78d8af74e2cadce3a0c793b4440"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/579eb78d8af74e2cadce3a0c793b4440"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}] Jun 07 22:15:59.942642 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Tenant: tempest-TestVolumeBootPattern-843087113 Jun 07 22:15:59.942642 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Tenant-Id: 579eb78d8af74e2cadce3a0c793b4440 Jun 07 22:15:59.942642 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-Tenant-Name: tempest-TestVolumeBootPattern-843087113 Jun 07 22:15:59.942642 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User: tempest-TestVolumeBootPattern-843087113-project Jun 07 22:15:59.942642 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Domain-Id: default Jun 07 22:15:59.942642 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Domain-Name: Default Jun 07 22:15:59.942642 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Id: c710942802df49ec8bd630e4b225eed2 Jun 07 22:15:59.942642 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: X-User-Name: tempest-TestVolumeBootPattern-843087113-project Jun 07 22:15:59.942642 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: method: > Jun 07 22:15:59.942642 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: exception: Instance c2ece8dd-91fb-472c-b0c7-970ee215412f could not be found. Jun 07 22:15:59.942642 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: action_args: {'id': 'c2ece8dd-91fb-472c-b0c7-970ee215412f'} Jun 07 22:15:59.943627 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 22:15:59.943627 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:15:59.943627 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 22:15:59.943627 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 22:15:59.943627 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 22:15:59.943627 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 22:15:59.943627 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 22:15:59.943627 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 22:15:59.943627 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 22:15:59.943627 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 22:15:59.943627 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2ece8dd-91fb-472c-b0c7-970ee215412f could not be found. Jun 07 22:15:59.943627 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:15:59.943627 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:15:59.943627 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:15:59.943627 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:15:59.943627 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:15:59.943627 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:15:59.943627 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 22:15:59.943627 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 22:15:59.943627 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 22:15:59.945363 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 22:15:59.945363 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 22:15:59.945363 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 22:15:59.945363 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 22:15:59.945363 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 22:15:59.945363 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 22:15:59.945363 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 22:15:59.945363 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2ece8dd-91fb-472c-b0c7-970ee215412f could not be found. Jun 07 22:15:59.945363 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:15:59.945363 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:15:59.945363 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:15:59.945363 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:15:59.945363 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:15:59.945363 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:15:59.945363 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 22:15:59.945363 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 22:15:59.945363 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2ece8dd-91fb-472c-b0c7-970ee215412f could not be found. Jun 07 22:15:59.945363 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: ERROR nova.api.openstack.wsgi Jun 07 22:15:59.947048 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-c55d5980-4c19-474d-8dd1-3d4cf31b1ca7 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Returning 404 to user: Instance c2ece8dd-91fb-472c-b0c7-970ee215412f could not be found. {{(pid=117970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 22:15:59.947048 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-c55d5980-4c19-474d-8dd1-3d4cf31b1ca7 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f" status: 404 len: 111 microversion: 2.1 time: 0.028305 Jun 07 22:15:59.947048 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 700/1429] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:15:59 2022] GET /compute/v2.1/servers/c2ece8dd-91fb-472c-b0c7-970ee215412f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 22:16:00.241283 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-49757761-966f-4a4d-9871-c2371f7afa9c tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:16:00.242085 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-49757761-966f-4a4d-9871-c2371f7afa9c tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] [instance: 4d8ab38f-db6d-4560-962e-c1e55c509ce1] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:16:00.250020 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-49757761-966f-4a4d-9871-c2371f7afa9c tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:16:00.250470 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-49757761-966f-4a4d-9871-c2371f7afa9c tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:16:00.251366 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-49757761-966f-4a4d-9871-c2371f7afa9c tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:16:00.251796 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-49757761-966f-4a4d-9871-c2371f7afa9c tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:16:00.387645 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-49757761-966f-4a4d-9871-c2371f7afa9c tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e8c46b1820a4ce5ac853ab1cc88fc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98914183afee4e58ad7a425cb019e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:16:00.395203 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-49757761-966f-4a4d-9871-c2371f7afa9c tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] 10.222.0.13 "GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1" status: 200 len: 1576 microversion: 2.1 time: 0.158241 Jun 07 22:16:00.396632 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 730/1430] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:16:00 2022] GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1 => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:16:01.225994 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-8a49c9c1-e3cb-4984-ab2c-7835681214a1 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] Calling method '.version_select at 0x7f92f0f91670>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:16:01.245208 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-8a49c9c1-e3cb-4984-ab2c-7835681214a1 tempest-TestVolumeBootPattern-843087113 tempest-TestVolumeBootPattern-843087113-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1489617035" status: 202 len: 0 microversion: 2.1 time: 0.023613 Jun 07 22:16:01.245808 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 701/1431] 10.222.0.13 () {58 vars in 1262 bytes} [Tue Jun 7 22:16:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1489617035 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 22:16:01.413846 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-01921dac-5584-46b5-b51c-4de8e9f755f0 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:16:01.414460 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-01921dac-5584-46b5-b51c-4de8e9f755f0 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] [instance: 4d8ab38f-db6d-4560-962e-c1e55c509ce1] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:16:01.421100 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-01921dac-5584-46b5-b51c-4de8e9f755f0 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:16:01.421552 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-01921dac-5584-46b5-b51c-4de8e9f755f0 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:16:01.422323 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-01921dac-5584-46b5-b51c-4de8e9f755f0 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:16:01.422753 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-01921dac-5584-46b5-b51c-4de8e9f755f0 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:16:01.672126 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-01921dac-5584-46b5-b51c-4de8e9f755f0 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e8c46b1820a4ce5ac853ab1cc88fc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98914183afee4e58ad7a425cb019e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:16:01.680884 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-01921dac-5584-46b5-b51c-4de8e9f755f0 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] 10.222.0.13 "GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1" status: 200 len: 1576 microversion: 2.1 time: 0.271934 Jun 07 22:16:01.690234 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 731/1432] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:16:01 2022] GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1 => generated 1576 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:16:02.696841 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-611af626-4c2d-420b-a8c8-116011c2f78d tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:16:02.698590 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-611af626-4c2d-420b-a8c8-116011c2f78d tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] [instance: 4d8ab38f-db6d-4560-962e-c1e55c509ce1] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:16:02.707014 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-611af626-4c2d-420b-a8c8-116011c2f78d tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:16:02.707732 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-611af626-4c2d-420b-a8c8-116011c2f78d tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:16:02.708884 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-611af626-4c2d-420b-a8c8-116011c2f78d tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:16:02.709330 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-611af626-4c2d-420b-a8c8-116011c2f78d tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:16:02.863071 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-611af626-4c2d-420b-a8c8-116011c2f78d tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e8c46b1820a4ce5ac853ab1cc88fc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98914183afee4e58ad7a425cb019e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:16:02.882079 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-611af626-4c2d-420b-a8c8-116011c2f78d tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] 10.222.0.13 "GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1" status: 200 len: 1576 microversion: 2.1 time: 0.188843 Jun 07 22:16:02.885068 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 702/1433] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:16:02 2022] GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1 => generated 1576 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:16:03.904266 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-1870a93d-489a-41cb-885b-c4d26e881f68 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:16:03.905525 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-1870a93d-489a-41cb-885b-c4d26e881f68 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] [instance: 4d8ab38f-db6d-4560-962e-c1e55c509ce1] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:16:03.913156 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-1870a93d-489a-41cb-885b-c4d26e881f68 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:16:03.913931 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-1870a93d-489a-41cb-885b-c4d26e881f68 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:16:03.914920 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-1870a93d-489a-41cb-885b-c4d26e881f68 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:16:03.915365 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-1870a93d-489a-41cb-885b-c4d26e881f68 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:16:03.936145 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_cell1:SELECT=100 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:16:04.079701 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-1870a93d-489a-41cb-885b-c4d26e881f68 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e8c46b1820a4ce5ac853ab1cc88fc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98914183afee4e58ad7a425cb019e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:16:04.093744 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-1870a93d-489a-41cb-885b-c4d26e881f68 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] 10.222.0.13 "GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1" status: 200 len: 1576 microversion: 2.1 time: 0.195756 Jun 07 22:16:04.094330 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 732/1434] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:16:03 2022] GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1 => generated 1576 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:16:05.027493 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [req-678a3ca8-7be5-4da6-aa0b-988d63b786e3 req-6cf9ab63-83ec-495b-b8f5-a355e404fe5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d8ab38f-db6d-4560-962e-c1e55c509ce1", "name": "network-vif-plugged", "status": "completed", "tag": "c6cae0af-2220-44aa-8bba-70f301632681"}]} {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:16:05.037009 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [req-678a3ca8-7be5-4da6-aa0b-988d63b786e3 req-6cf9ab63-83ec-495b-b8f5-a355e404fe5f service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:16:05.037925 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [req-678a3ca8-7be5-4da6-aa0b-988d63b786e3 req-6cf9ab63-83ec-495b-b8f5-a355e404fe5f service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:16:05.050949 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.compute.server_external_events [req-678a3ca8-7be5-4da6-aa0b-988d63b786e3 req-6cf9ab63-83ec-495b-b8f5-a355e404fe5f service nova] Creating event network-vif-plugged:c6cae0af-2220-44aa-8bba-70f301632681 for instance 4d8ab38f-db6d-4560-962e-c1e55c509ce1 on hv-cinder-83552 Jun 07 22:16:05.057326 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [req-678a3ca8-7be5-4da6-aa0b-988d63b786e3 req-6cf9ab63-83ec-495b-b8f5-a355e404fe5f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033426 Jun 07 22:16:05.058885 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 703/1435] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:16:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:16:05.113628 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-f50f5fda-85e7-4288-a285-cdb6343814e2 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:16:05.114429 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-f50f5fda-85e7-4288-a285-cdb6343814e2 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] [instance: 4d8ab38f-db6d-4560-962e-c1e55c509ce1] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:16:05.130413 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-f50f5fda-85e7-4288-a285-cdb6343814e2 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:16:05.130911 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-f50f5fda-85e7-4288-a285-cdb6343814e2 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:16:05.131734 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-f50f5fda-85e7-4288-a285-cdb6343814e2 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:16:05.132572 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-f50f5fda-85e7-4288-a285-cdb6343814e2 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:16:05.451191 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-f50f5fda-85e7-4288-a285-cdb6343814e2 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e8c46b1820a4ce5ac853ab1cc88fc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98914183afee4e58ad7a425cb019e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:16:05.459524 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-f50f5fda-85e7-4288-a285-cdb6343814e2 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] 10.222.0.13 "GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1" status: 200 len: 1576 microversion: 2.1 time: 0.352427 Jun 07 22:16:05.460101 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 733/1436] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:16:05 2022] GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1 => generated 1576 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:16:06.479109 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-cdbab723-b78a-455c-bea7-f37a8e51792c tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:16:06.479976 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-cdbab723-b78a-455c-bea7-f37a8e51792c tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] [instance: 4d8ab38f-db6d-4560-962e-c1e55c509ce1] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:16:06.489415 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-cdbab723-b78a-455c-bea7-f37a8e51792c tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:16:06.489861 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-cdbab723-b78a-455c-bea7-f37a8e51792c tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:16:06.490732 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-cdbab723-b78a-455c-bea7-f37a8e51792c tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:16:06.491399 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-cdbab723-b78a-455c-bea7-f37a8e51792c tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:16:06.663432 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-cdbab723-b78a-455c-bea7-f37a8e51792c tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e8c46b1820a4ce5ac853ab1cc88fc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98914183afee4e58ad7a425cb019e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:16:06.674228 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-cdbab723-b78a-455c-bea7-f37a8e51792c tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] 10.222.0.13 "GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1" status: 200 len: 1576 microversion: 2.1 time: 0.200624 Jun 07 22:16:06.674823 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 704/1437] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:16:06 2022] GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1 => generated 1576 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:16:07.693452 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-61afecdb-f636-4f92-b9d3-e74583415d29 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:16:07.694291 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-61afecdb-f636-4f92-b9d3-e74583415d29 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] [instance: 4d8ab38f-db6d-4560-962e-c1e55c509ce1] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:16:07.700918 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-61afecdb-f636-4f92-b9d3-e74583415d29 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:16:07.701515 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-61afecdb-f636-4f92-b9d3-e74583415d29 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:16:07.702346 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-61afecdb-f636-4f92-b9d3-e74583415d29 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:16:07.702771 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-61afecdb-f636-4f92-b9d3-e74583415d29 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:16:07.841272 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-61afecdb-f636-4f92-b9d3-e74583415d29 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e8c46b1820a4ce5ac853ab1cc88fc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98914183afee4e58ad7a425cb019e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:16:07.850138 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-61afecdb-f636-4f92-b9d3-e74583415d29 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] 10.222.0.13 "GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1" status: 200 len: 1576 microversion: 2.1 time: 0.161509 Jun 07 22:16:07.855438 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 734/1438] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:16:07 2022] GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1 => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:16:08.867894 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-5080402c-cd3f-4913-87f2-62c4e2413fce tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:16:08.868673 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-5080402c-cd3f-4913-87f2-62c4e2413fce tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] [instance: 4d8ab38f-db6d-4560-962e-c1e55c509ce1] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:16:08.875854 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-5080402c-cd3f-4913-87f2-62c4e2413fce tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:16:08.876321 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-5080402c-cd3f-4913-87f2-62c4e2413fce tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:16:08.877097 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-5080402c-cd3f-4913-87f2-62c4e2413fce tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:16:08.877525 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-5080402c-cd3f-4913-87f2-62c4e2413fce tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:16:09.025313 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-5080402c-cd3f-4913-87f2-62c4e2413fce tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e8c46b1820a4ce5ac853ab1cc88fc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98914183afee4e58ad7a425cb019e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:16:09.032831 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-5080402c-cd3f-4913-87f2-62c4e2413fce tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] 10.222.0.13 "GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1" status: 200 len: 1576 microversion: 2.1 time: 0.168957 Jun 07 22:16:09.033400 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 705/1439] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:16:08 2022] GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1 => generated 1576 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:16:10.050492 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-a0606651-5b54-433e-8e9f-8c5d48122c50 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:16:10.051122 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-a0606651-5b54-433e-8e9f-8c5d48122c50 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] [instance: 4d8ab38f-db6d-4560-962e-c1e55c509ce1] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:16:10.060860 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a0606651-5b54-433e-8e9f-8c5d48122c50 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:16:10.061316 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a0606651-5b54-433e-8e9f-8c5d48122c50 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:16:10.062088 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a0606651-5b54-433e-8e9f-8c5d48122c50 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:16:10.062528 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-a0606651-5b54-433e-8e9f-8c5d48122c50 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:16:10.194752 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-a0606651-5b54-433e-8e9f-8c5d48122c50 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e8c46b1820a4ce5ac853ab1cc88fc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98914183afee4e58ad7a425cb019e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:16:10.202229 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-a0606651-5b54-433e-8e9f-8c5d48122c50 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] 10.222.0.13 "GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1" status: 200 len: 1576 microversion: 2.1 time: 0.155579 Jun 07 22:16:10.202789 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 735/1440] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:16:10 2022] GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:16:11.218594 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-0ab2a1c6-c180-444b-aef8-960522934e58 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:16:11.219157 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-0ab2a1c6-c180-444b-aef8-960522934e58 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] [instance: 4d8ab38f-db6d-4560-962e-c1e55c509ce1] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:16:11.227311 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0ab2a1c6-c180-444b-aef8-960522934e58 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:16:11.227824 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0ab2a1c6-c180-444b-aef8-960522934e58 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:16:11.228888 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0ab2a1c6-c180-444b-aef8-960522934e58 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:16:11.229326 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-0ab2a1c6-c180-444b-aef8-960522934e58 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:16:11.361495 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-0ab2a1c6-c180-444b-aef8-960522934e58 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e8c46b1820a4ce5ac853ab1cc88fc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98914183afee4e58ad7a425cb019e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:16:11.371814 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-0ab2a1c6-c180-444b-aef8-960522934e58 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] 10.222.0.13 "GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1" status: 200 len: 1563 microversion: 2.1 time: 0.156913 Jun 07 22:16:11.372687 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 706/1441] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:16:11 2022] GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1 => generated 1563 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:16:53.954274 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 22:16:53.954835 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Tue Jun 7 22:16:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 22:17:28.458635 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 22:17:28.459373 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Tue Jun 7 22:17:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 22:17:51.897074 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_api:SELECT=25 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:17:51.897960 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG dbcounter [-] [117971] Writing DB stats nova_cell1:SELECT=20 {{(pid=117971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:17:51.904227 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:17:51.904736 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-cc54b21d-1e08-4274-9c8a-b316764a23b8 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:17:51.905141 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-cc54b21d-1e08-4274-9c8a-b316764a23b8 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] [instance: 4d8ab38f-db6d-4560-962e-c1e55c509ce1] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:17:51.905447 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG dbcounter [-] [117970] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:17:51.914122 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-cc54b21d-1e08-4274-9c8a-b316764a23b8 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:17:51.915387 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-cc54b21d-1e08-4274-9c8a-b316764a23b8 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:17:51.916389 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-cc54b21d-1e08-4274-9c8a-b316764a23b8 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:17:51.917892 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-cc54b21d-1e08-4274-9c8a-b316764a23b8 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:17:51.955216 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-cc54b21d-1e08-4274-9c8a-b316764a23b8 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] [instance: 4d8ab38f-db6d-4560-962e-c1e55c509ce1] Going to try to terminate instance {{(pid=117971) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 22:17:52.041759 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-cc54b21d-1e08-4274-9c8a-b316764a23b8 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] 10.222.0.13 "DELETE /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1" status: 204 len: 0 microversion: 2.1 time: 0.146456 Jun 07 22:17:52.042882 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 736/1442] 10.222.0.13 () {58 vars in 1238 bytes} [Tue Jun 7 22:17:51 2022] DELETE /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 22:17:52.051929 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-321574c4-5929-4837-9524-23e8f997306c tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:17:52.052712 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-321574c4-5929-4837-9524-23e8f997306c tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] [instance: 4d8ab38f-db6d-4560-962e-c1e55c509ce1] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:17:52.060119 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-321574c4-5929-4837-9524-23e8f997306c tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:17:52.060642 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-321574c4-5929-4837-9524-23e8f997306c tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:17:52.061481 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-321574c4-5929-4837-9524-23e8f997306c tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:17:52.061994 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-321574c4-5929-4837-9524-23e8f997306c tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:17:52.096827 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [req-c84f54fa-3354-4d20-bd79-539ade61f07d req-32abd9df-5485-415d-b6d9-798608b35435 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d8ab38f-db6d-4560-962e-c1e55c509ce1", "tag": "c6cae0af-2220-44aa-8bba-70f301632681"}]} {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:17:52.105777 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [req-c84f54fa-3354-4d20-bd79-539ade61f07d req-32abd9df-5485-415d-b6d9-798608b35435 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:17:52.106219 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [req-c84f54fa-3354-4d20-bd79-539ade61f07d req-32abd9df-5485-415d-b6d9-798608b35435 service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:17:52.119572 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.compute.server_external_events [req-c84f54fa-3354-4d20-bd79-539ade61f07d req-32abd9df-5485-415d-b6d9-798608b35435 service nova] Creating event network-changed:c6cae0af-2220-44aa-8bba-70f301632681 for instance 4d8ab38f-db6d-4560-962e-c1e55c509ce1 on hv-cinder-83552 Jun 07 22:17:52.125565 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [req-c84f54fa-3354-4d20-bd79-539ade61f07d req-32abd9df-5485-415d-b6d9-798608b35435 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.224932 Jun 07 22:17:52.126179 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 707/1443] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:17:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 22:17:52.205119 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.policy [None req-321574c4-5929-4837-9524-23e8f997306c tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e8c46b1820a4ce5ac853ab1cc88fc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98914183afee4e58ad7a425cb019e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117971) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:17:52.212658 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-321574c4-5929-4837-9524-23e8f997306c tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] 10.222.0.13 "GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1" status: 200 len: 1569 microversion: 2.1 time: 0.165186 Jun 07 22:17:52.213224 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 737/1444] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:17:52 2022] GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1 => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:17:53.231681 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-d083bad1-781f-48fb-aaf1-f2dcf7e794aa tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:17:53.232533 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-d083bad1-781f-48fb-aaf1-f2dcf7e794aa tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] [instance: 4d8ab38f-db6d-4560-962e-c1e55c509ce1] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:17:53.238690 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d083bad1-781f-48fb-aaf1-f2dcf7e794aa tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:17:53.239138 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d083bad1-781f-48fb-aaf1-f2dcf7e794aa tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:17:53.239919 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d083bad1-781f-48fb-aaf1-f2dcf7e794aa tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:17:53.240350 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-d083bad1-781f-48fb-aaf1-f2dcf7e794aa tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:17:53.423274 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-d083bad1-781f-48fb-aaf1-f2dcf7e794aa tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e8c46b1820a4ce5ac853ab1cc88fc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98914183afee4e58ad7a425cb019e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:17:53.430982 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-d083bad1-781f-48fb-aaf1-f2dcf7e794aa tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] 10.222.0.13 "GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1" status: 200 len: 1569 microversion: 2.1 time: 0.204985 Jun 07 22:17:53.431575 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 708/1445] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:17:53 2022] GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1 => generated 1569 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:17:54.420522 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [req-3754c98f-213b-49f6-bbcb-1aa2ca3648cc req-e053cae1-3b85-496a-aaa6-63162f11181d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d8ab38f-db6d-4560-962e-c1e55c509ce1", "name": "network-vif-deleted", "tag": "c6cae0af-2220-44aa-8bba-70f301632681"}]} {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 22:17:54.429323 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-3754c98f-213b-49f6-bbcb-1aa2ca3648cc req-e053cae1-3b85-496a-aaa6-63162f11181d service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:17:54.429763 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [req-3754c98f-213b-49f6-bbcb-1aa2ca3648cc req-e053cae1-3b85-496a-aaa6-63162f11181d service nova] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:17:54.441236 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.compute.server_external_events [req-3754c98f-213b-49f6-bbcb-1aa2ca3648cc req-e053cae1-3b85-496a-aaa6-63162f11181d service nova] Creating event network-vif-deleted:c6cae0af-2220-44aa-8bba-70f301632681 for instance 4d8ab38f-db6d-4560-962e-c1e55c509ce1 on hv-cinder-83552 Jun 07 22:17:54.446665 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [req-3754c98f-213b-49f6-bbcb-1aa2ca3648cc req-e053cae1-3b85-496a-aaa6-63162f11181d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030502 Jun 07 22:17:54.447303 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 738/1446] 10.222.0.13 () {64 vars in 1317 bytes} [Tue Jun 7 22:17:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 22:17:54.448547 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-f60b31dc-2ca9-4c88-9ce2-2b681d1baa38 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Calling method '>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:17:54.450264 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.compute.api [None req-f60b31dc-2ca9-4c88-9ce2-2b681d1baa38 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] [instance: 4d8ab38f-db6d-4560-962e-c1e55c509ce1] Fetching instance by UUID {{(pid=117970) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:17:54.457220 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f60b31dc-2ca9-4c88-9ce2-2b681d1baa38 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:17:54.457660 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f60b31dc-2ca9-4c88-9ce2-2b681d1baa38 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:17:54.458407 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f60b31dc-2ca9-4c88-9ce2-2b681d1baa38 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:17:54.458834 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG oslo_concurrency.lockutils [None req-f60b31dc-2ca9-4c88-9ce2-2b681d1baa38 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:17:54.523804 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.policy [None req-f60b31dc-2ca9-4c88-9ce2-2b681d1baa38 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e8c46b1820a4ce5ac853ab1cc88fc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98914183afee4e58ad7a425cb019e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117970) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 22:17:54.532205 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-f60b31dc-2ca9-4c88-9ce2-2b681d1baa38 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] 10.222.0.13 "GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1" status: 200 len: 1219 microversion: 2.1 time: 0.087978 Jun 07 22:17:54.532763 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 709/1447] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:17:54 2022] GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 22:17:55.550266 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-05053d47-ed1e-45e4-88c1-278c99cbc2b4 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Calling method '>' {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:17:55.550959 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.compute.api [None req-05053d47-ed1e-45e4-88c1-278c99cbc2b4 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] [instance: 4d8ab38f-db6d-4560-962e-c1e55c509ce1] Fetching instance by UUID {{(pid=117971) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 22:17:55.557248 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-05053d47-ed1e-45e4-88c1-278c99cbc2b4 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:17:55.557694 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-05053d47-ed1e-45e4-88c1-278c99cbc2b4 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:17:55.558451 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-05053d47-ed1e-45e4-88c1-278c99cbc2b4 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 22:17:55.559746 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG oslo_concurrency.lockutils [None req-05053d47-ed1e-45e4-88c1-278c99cbc2b4 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Lock "5130ba80-aa16-48e5-a7f8-322f7966dcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 22:17:55.572607 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.wsgi [None req-05053d47-ed1e-45e4-88c1-278c99cbc2b4 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] HTTP exception thrown: Instance 4d8ab38f-db6d-4560-962e-c1e55c509ce1 could not be found. Jun 07 22:17:55.574199 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-05053d47-ed1e-45e4-88c1-278c99cbc2b4 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Request method failure captured: Jun 07 22:17:55.574199 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: request: GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1 HTTP/1.1 Jun 07 22:17:55.574199 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Accept: application/json Jun 07 22:17:55.574199 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Accept-Encoding: identity Jun 07 22:17:55.574199 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Connection: close Jun 07 22:17:55.574199 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Content-Length: 0 Jun 07 22:17:55.574199 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Content-Type: application/json Jun 07 22:17:55.574199 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Host: 10.222.0.13 Jun 07 22:17:55.574199 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Openstack-System-Scope: None Jun 07 22:17:55.574199 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: User-Agent: python-urllib3/1.26.9 Jun 07 22:17:55.574199 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Auth-Token: gAAAAABin80XhVPDtjZYnYLd9g5pWjnlpkpaup7ySWGxLp06Nbwfm2IohFgTkXGJFD-8DeIkoKisL7-O_pQHcEp9S3Of90xSQe2-m_4FN8x8AA10OsOnaujmAHcs20ee7FX_0Swcg429b2KVYLTFzBcoLtnSrwqQ5m5_MDQd3-7970Lk0me26is Jun 07 22:17:55.574199 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Domain-Id: None Jun 07 22:17:55.574199 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Domain-Name: None Jun 07 22:17:55.574199 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Identity-Status: Confirmed Jun 07 22:17:55.574199 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Is-Admin-Project: True Jun 07 22:17:55.574199 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Domain-Id: default Jun 07 22:17:55.574199 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Domain-Name: Default Jun 07 22:17:55.574199 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Id: 98914183afee4e58ad7a425cb019e639 Jun 07 22:17:55.574199 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Project-Name: tempest-TestShelveInstance-1007341608 Jun 07 22:17:55.574199 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Role: member,reader Jun 07 22:17:55.574199 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Roles: member,reader Jun 07 22:17:55.576089 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/98914183afee4e58ad7a425cb019e639"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_98914183afee4e58ad7a425cb019e639"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/98914183afee4e58ad7a425cb019e639"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/98914183afee4e58ad7a425cb019e639"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}] Jun 07 22:17:55.576089 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant: tempest-TestShelveInstance-1007341608 Jun 07 22:17:55.576089 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant-Id: 98914183afee4e58ad7a425cb019e639 Jun 07 22:17:55.576089 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-Tenant-Name: tempest-TestShelveInstance-1007341608 Jun 07 22:17:55.576089 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User: tempest-TestShelveInstance-1007341608-project Jun 07 22:17:55.576089 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Domain-Id: default Jun 07 22:17:55.576089 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Domain-Name: Default Jun 07 22:17:55.576089 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Id: 7e8c46b1820a4ce5ac853ab1cc88fc30 Jun 07 22:17:55.576089 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: X-User-Name: tempest-TestShelveInstance-1007341608-project Jun 07 22:17:55.576089 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: method: > Jun 07 22:17:55.576089 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: exception: Instance 4d8ab38f-db6d-4560-962e-c1e55c509ce1 could not be found. Jun 07 22:17:55.576089 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: action_args: {'id': '4d8ab38f-db6d-4560-962e-c1e55c509ce1'} Jun 07 22:17:55.577206 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: {{(pid=117971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 22:17:55.577206 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:17:55.577206 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 22:17:55.577206 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 22:17:55.577206 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 22:17:55.577206 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 22:17:55.577206 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 22:17:55.577206 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 22:17:55.577206 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 22:17:55.577206 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 22:17:55.577206 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d8ab38f-db6d-4560-962e-c1e55c509ce1 could not be found. Jun 07 22:17:55.577206 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:17:55.577206 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:17:55.577206 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:17:55.577206 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:17:55.577206 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:17:55.577206 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:17:55.577206 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 22:17:55.577206 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 22:17:55.577206 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 22:17:55.578684 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 22:17:55.578684 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 22:17:55.578684 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 22:17:55.578684 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 22:17:55.578684 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 22:17:55.578684 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 22:17:55.578684 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 22:17:55.578684 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d8ab38f-db6d-4560-962e-c1e55c509ce1 could not be found. Jun 07 22:17:55.578684 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:17:55.578684 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 22:17:55.578684 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:17:55.578684 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 22:17:55.578684 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 22:17:55.578684 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 22:17:55.578684 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 22:17:55.578684 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 22:17:55.578684 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d8ab38f-db6d-4560-962e-c1e55c509ce1 could not be found. Jun 07 22:17:55.578684 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: ERROR nova.api.openstack.wsgi Jun 07 22:17:55.580305 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: DEBUG nova.api.openstack.wsgi [None req-05053d47-ed1e-45e4-88c1-278c99cbc2b4 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Returning 404 to user: Instance 4d8ab38f-db6d-4560-962e-c1e55c509ce1 could not be found. {{(pid=117971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 22:17:55.580305 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO nova.api.openstack.requestlog [None req-05053d47-ed1e-45e4-88c1-278c99cbc2b4 tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] 10.222.0.13 "GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1" status: 404 len: 111 microversion: 2.1 time: 0.030305 Jun 07 22:17:55.580305 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: [pid: 117971|app: 0|req: 739/1448] 10.222.0.13 () {58 vars in 1235 bytes} [Tue Jun 7 22:17:55 2022] GET /compute/v2.1/servers/4d8ab38f-db6d-4560-962e-c1e55c509ce1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 22:17:55.735503 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: DEBUG nova.api.openstack.wsgi [None req-dbe18c63-0d2f-483a-a9ad-c4934d74872c tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] Calling method '.version_select at 0x7f92f0f6c550>' {{(pid=117970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 22:17:55.753898 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO nova.api.openstack.requestlog [None req-dbe18c63-0d2f-483a-a9ad-c4934d74872c tempest-TestShelveInstance-1007341608 tempest-TestShelveInstance-1007341608-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-813171803" status: 202 len: 0 microversion: 2.1 time: 0.022357 Jun 07 22:17:55.757850 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: [pid: 117970|app: 0|req: 710/1449] 10.222.0.13 () {58 vars in 1250 bytes} [Tue Jun 7 22:17:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-813171803 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 22:18:10.695642 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 22:18:10.696398 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Tue Jun 7 22:18:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 22:20:13.962754 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 22:20:13.963384 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Tue Jun 7 22:20:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 22:20:34.996113 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 22:20:34.996701 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Tue Jun 7 22:20:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 22:20:48.467377 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 22:20:48.467906 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Tue Jun 7 22:20:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 22:21:30.704232 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 22:21:30.704972 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Tue Jun 7 22:21:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 22:23:23.812637 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 22:23:23.813109 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Tue Jun 7 22:23:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 22:23:24.836622 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 22:23:24.837147 dv-cinder-835525-4-iscsi devstack@n-api.service[117970]: Tue Jun 7 22:23:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 22:23:33.972012 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 22:23:33.972528 dv-cinder-835525-4-iscsi devstack@n-api.service[117971]: Tue Jun 7 22:23:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!